-- Logs begin at Mon 2022-07-25 11:32:04 UTC, end at Mon 2022-07-25 12:35:24 UTC. -- Jul 25 12:05:57.077838 dv-cinder-797608-61-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 12:05:57.086972 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 12:05:57.089018 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 12:05:57 2022] *** Jul 25 12:05:57.089018 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 12:05:57.089018 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 12:05:57.089018 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: nodename: dv-cinder-797608-61-iscsi Jul 25 12:05:57.089018 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: machine: x86_64 Jul 25 12:05:57.089018 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: clock source: unix Jul 25 12:05:57.089018 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: pcre jit disabled Jul 25 12:05:57.089018 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: detected number of CPU cores: 4 Jul 25 12:05:57.089018 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: current working directory: / Jul 25 12:05:57.089018 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: detected binary path: /usr/bin/uwsgi-core Jul 25 12:05:57.089018 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: your processes number limit is 47680 Jul 25 12:05:57.089664 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: your memory page size is 4096 bytes Jul 25 12:05:57.089664 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: detected max file descriptor number: 2048 Jul 25 12:05:57.089664 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: lock engine: pthread robust mutexes Jul 25 12:05:57.089664 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: thunder lock: enabled Jul 25 12:05:57.089664 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 12:05:57.089664 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 12:05:57.127258 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: Python main interpreter initialized at 0x55b63165f9c0 Jul 25 12:05:57.127258 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: python threads support enabled Jul 25 12:05:57.127258 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: your server socket listen backlog is limited to 100 connections Jul 25 12:05:57.127258 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: your mercy for graceful operations on workers is 90 seconds Jul 25 12:05:57.127632 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 12:05:57.127709 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: *** Operational MODE: preforking *** Jul 25 12:05:57.127935 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: *** uWSGI is running in multiple interpreter mode *** Jul 25 12:05:57.127935 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: spawned uWSGI master process (pid: 103268) Jul 25 12:05:57.128613 dv-cinder-797608-61-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 12:05:57.129763 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: spawned uWSGI worker 1 (pid: 103269, cores: 1) Jul 25 12:05:57.129763 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: spawned uWSGI worker 2 (pid: 103270, cores: 1) Jul 25 12:05:57.129763 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 12:05:57.784196 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 12:05:57.784650 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 12:05:58.869769 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:05:58.869769 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: from cryptography.utils import int_from_bytes Jul 25 12:05:58.870289 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:05:58.870289 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: from cryptography.utils import int_from_bytes Jul 25 12:05:58.870682 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:05:58.870682 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: from cryptography.utils import int_from_bytes Jul 25 12:05:58.870800 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:05:58.870800 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: from cryptography.utils import int_from_bytes Jul 25 12:06:01.374087 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:06:01.374674 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:06:01.374860 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:06:01.375117 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:06:01.375493 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:06:01.375655 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:06:01.375731 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:06:01.375878 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.375974 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:06:01.376196 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.376287 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:06:01.376518 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.376608 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:06:01.376842 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.376931 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.377174 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.377291 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.377484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.377583 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.378354 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.378446 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.378676 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.378774 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.378988 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.379123 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.379259 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.379389 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.379587 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.379719 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.379916 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-61-iscsi {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.380066 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.380202 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.380333 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.380500 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.380636 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.380825 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-61-iscsi {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.380953 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.381139 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.381272 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.381444 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.381570 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.381752 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.381900 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.382064 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.382213 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.382363 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.382558 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.382706 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.382988 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.383099 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.383292 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.383491 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.383613 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.383827 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.383955 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.384141 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.384249 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.384425 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.384556 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.384761 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.384896 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.385079 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.385210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.385405 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.385542 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.385696 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.385834 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.386003 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.386131 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-61-iscsi {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.386322 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.386463 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.386631 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.386761 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.387023 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-61-iscsi {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.387168 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.387337 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.387466 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.387689 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.387829 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.388004 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.388141 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.388375 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.388521 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.388697 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.388850 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.389038 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.389165 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.389311 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.389437 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.389625 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.389761 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.389930 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.390066 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.390248 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.390374 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.390550 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.390686 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.390858 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.390987 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.391164 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.391291 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.391462 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.391609 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.391780 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.391907 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.392084 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.392289 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.392427 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.392552 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.392685 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.392810 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.392941 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.393074 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.393208 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.393332 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.393530 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.393659 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.393809 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.393952 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.394086 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.394212 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.394362 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.394505 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.394681 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.394811 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.394935 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.395066 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.395238 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.395366 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.395603 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.395772 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.395988 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.396117 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.396242 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.396374 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.396514 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.396638 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.396761 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.396895 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.397045 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.397181 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.397349 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.397476 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.397654 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.397788 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.397959 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.398163 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.398292 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.398429 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.398555 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.398678 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.398883 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.399023 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.399190 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.399318 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.399498 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.399661 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.399862 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.400004 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.400165 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.400292 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.400474 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.400609 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.400789 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.400922 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.401112 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.401239 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.401417 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.401543 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.401720 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.401846 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.402026 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.402153 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.402338 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.402464 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.402645 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.402743 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.402952 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.403056 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.403203 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.403337 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.403505 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.403661 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.403834 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.403963 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.404140 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.404278 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.404440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.404576 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.404742 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.404875 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.405047 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.405252 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.405384 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.405553 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.405694 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.405885 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.406012 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.406145 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.406278 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.406409 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.406533 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.406663 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.406789 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.406925 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.407083 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.407219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.407384 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.407511 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.407710 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.407856 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.408010 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.408136 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.408315 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.408710 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.408913 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.409041 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.409220 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.409348 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.409522 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.409655 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.410088 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.410216 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.410332 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.410464 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.410589 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.410712 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.410847 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.410974 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.411104 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.411237 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.411369 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.411493 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.411652 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.411786 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.411911 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.412044 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.412212 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.412348 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.412564 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.412699 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.412824 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.412947 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.413104 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.413240 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.413400 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.413527 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.413701 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.413826 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.414012 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.414140 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.414308 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.414435 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.414609 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.414741 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.414911 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.415046 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.415213 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.415349 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.415514 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.415659 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.415838 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.416056 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.416187 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.416310 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.416432 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.416555 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.416711 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.416851 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.417012 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.417140 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.417313 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.417452 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.417611 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.417746 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.417911 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.418037 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.418216 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.418345 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.418524 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.418693 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.418820 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.418943 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.419118 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.419246 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.419436 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:06:01.419623 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.419794 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.419921 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.420130 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.420259 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.420459 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.420594 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.420776 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.420901 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.421086 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.421218 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.421401 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.421536 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.421726 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.421859 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.422037 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.422172 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.422345 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.422479 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.422680 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.422810 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.422963 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.423100 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.423272 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.423399 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.423612 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.423755 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.423929 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.424073 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.424327 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.424458 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.425076 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.425200 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.425365 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.425502 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.425679 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.425805 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.425998 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.426209 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.426338 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.426536 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.426665 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.426793 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.426924 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.427058 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.427233 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.427370 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.427580 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.427712 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.427905 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.428044 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.428225 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.428352 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.428538 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.428667 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.428851 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.428989 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.429163 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.429300 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.429474 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.429601 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.429785 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.429914 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.430097 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.430233 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.430413 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.430552 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.430726 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.430863 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.431039 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.431169 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.431352 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.431487 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.431686 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.431833 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.431999 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.432127 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.432311 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.432439 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.432623 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.432836 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.432965 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.433088 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.433236 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.433361 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.433554 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.433690 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.433868 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.433996 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.434177 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.434310 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.434487 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.434622 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.434793 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.434927 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.435099 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.435233 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.435404 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.435596 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.435737 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.435868 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.436030 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.436156 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.436370 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.436498 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.436623 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.436746 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.436919 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.437054 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.437244 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.437373 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.437574 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.437709 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.437879 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.438006 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.438199 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.438326 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.438486 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.438614 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.438793 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.438921 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.439102 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.439239 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.439413 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.439563 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.439745 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.439884 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.440060 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.440221 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.440952 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.441079 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.441260 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.441397 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.441585 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.441712 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.441893 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.442021 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.442198 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.442333 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.442509 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.442645 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.442890 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.443035 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.443161 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.443304 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.443440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.443605 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.443733 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.443858 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.444046 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.444176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.444358 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.444494 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.444670 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.444797 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.444997 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.445126 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.445310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.445438 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.445617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.445743 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.445944 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.446085 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.446272 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.446478 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.446614 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.446739 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.446872 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.446997 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.447174 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.447312 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.447483 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.447664 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.447799 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.447932 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.448104 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.448233 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.448407 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.448542 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.448708 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.448846 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.449010 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.449145 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.449310 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.449446 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.449612 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.449740 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.449913 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.450040 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.450213 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.450356 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.450518 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.450652 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.450823 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.450960 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.451129 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.451266 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.451432 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.451601 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.451763 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.451901 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.452068 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.452205 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.452372 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.452508 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.452715 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.452852 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.453026 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.453144 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.453360 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.453459 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.453673 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.453771 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.453990 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.454087 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.454301 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.454397 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.454613 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.454720 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.454924 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.455029 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.455233 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.455341 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.455574 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.455755 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.455915 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.456011 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.456228 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.456314 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.456541 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.456648 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.456849 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.456934 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.457160 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.457253 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.457470 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.457563 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.457779 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.457865 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.458093 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.458178 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.458416 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.458503 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.458723 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.458808 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.459038 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.459125 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.459362 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.459455 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.459697 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.459788 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.460015 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.460103 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.460324 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.460412 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.460635 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.460734 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.460946 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.461032 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.461254 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.461341 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.461566 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.461667 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.461876 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.461970 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.462184 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.462271 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.462490 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.462576 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.462801 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.462894 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.463109 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.463199 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.463416 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.463516 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.463742 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.463841 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.464056 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.464144 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.464377 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.464462 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.464683 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.464781 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.464997 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.465083 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.465306 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.465399 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.465624 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.465720 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.465933 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.466027 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.466243 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.466329 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.466628 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.466793 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.466937 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.467078 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.467217 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.467356 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.467507 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.467684 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.467837 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.467978 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.468131 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.468270 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.468419 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.468560 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.468707 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.468857 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.468997 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.469136 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.469283 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.469424 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.469562 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.469708 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.469860 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.470013 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.470162 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.470310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.470451 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.470590 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.470741 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.470894 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.471035 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.471182 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.471322 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.472027 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.472169 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.472330 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.472470 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.472697 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.472856 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.472998 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.473137 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.473371 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.473525 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.473666 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.473815 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.473955 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.474094 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.474242 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.474400 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.474540 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.474687 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.474827 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.474976 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.475117 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.475272 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.475422 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.475589 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.475735 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.475886 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.476028 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.476167 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.476322 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.476463 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.476602 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.476774 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.476916 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.477056 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.477194 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.477341 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.477488 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.477641 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.477781 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.477920 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.478069 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.478268 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.478425 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.478565 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.478712 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.478852 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.478999 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.479141 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.479304 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.479446 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.479603 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.479747 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.479886 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.480046 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.480197 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.480337 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.480476 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.480615 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.480761 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.480907 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.481056 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.481206 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.481460 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.481614 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.481762 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.481913 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.482098 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.482320 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.482473 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.482656 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.482802 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.482956 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.483097 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.483278 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.483515 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.483701 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.483844 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.483993 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.484153 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.484367 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.484523 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.484672 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.484812 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.484958 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.485120 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.485278 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.485428 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.485579 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.485720 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.485870 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.486011 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.486169 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.486310 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.486458 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.486599 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.486738 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.486877 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.487078 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.487737 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.487880 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.488026 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.488167 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.488307 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.488456 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.488615 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.488756 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.488903 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.489062 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.489256 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.489401 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.489553 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.489693 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.489832 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.489971 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.490118 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.490265 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.490405 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.490560 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.490700 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.490839 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.490987 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.491127 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.491273 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.491413 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.491609 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.491766 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.491917 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.492065 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.492212 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.492359 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.492517 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.492672 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.492813 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.492953 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.493092 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.493232 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.493379 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.493545 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.493754 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.493899 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.494038 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.494177 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.494326 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.494480 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.494621 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.494762 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.494901 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.495046 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.495200 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.495340 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.495479 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.495647 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.495788 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.495928 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.496140 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.496295 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.496434 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.496582 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.496722 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.496868 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.497022 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.497162 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.497301 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.497439 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.497577 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.497717 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.497864 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.498005 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.498154 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.498294 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.498433 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.498581 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.498721 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.498860 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.499000 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.499140 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.499286 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.499442 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.499621 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.499768 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.499917 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.500070 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.500218 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.500372 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.500521 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.500662 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.500801 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.500940 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.501080 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.501238 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.501379 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.501518 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.501657 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.501813 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.501963 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.502104 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.502243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.502384 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.502523 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.502689 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.502840 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.502980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.503120 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.503261 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.503433 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.503609 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.503793 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.504002 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.504147 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.504288 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.504436 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.504576 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.504725 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.504874 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.505022 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.505168 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.505310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.505458 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.505634 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.505791 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.505931 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.506071 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.506210 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.506360 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.506500 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.506648 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.506788 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.506928 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.507067 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.507216 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.507358 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.507505 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.507696 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.507838 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.507988 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.508208 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.508359 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.508501 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.508648 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.508788 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.508935 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.509076 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.509215 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.509354 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.509513 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.509663 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.509844 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.509985 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.510125 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.510264 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.510404 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.510545 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.510698 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.510841 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.510981 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.511128 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.511270 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.511429 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.511608 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.511756 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.511896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.512036 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.512176 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.512325 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.512466 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.512606 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.512753 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.512894 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.513033 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.513208 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.513368 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.513515 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.513656 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.513822 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.513982 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.514202 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.514354 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.514495 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.514636 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.514776 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.514915 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.515064 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.515206 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.515364 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.515506 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.515680 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.515823 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.515975 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.516116 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.516284 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.516431 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.516571 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.516784 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.516934 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.517074 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.517241 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.517402 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.517543 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.517695 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.517838 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.517978 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.518140 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.518314 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.518464 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.518614 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.518800 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.518941 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.519090 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.519230 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.519382 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.519610 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.519772 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.519914 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.520054 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.520238 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.520392 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.520533 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.520680 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.520820 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.520958 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.521098 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.521260 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.521402 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.521548 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.521688 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.521826 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.521965 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.522114 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.522261 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.522401 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.522540 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.522686 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.522825 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.522973 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.523125 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.523264 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.523410 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.523573 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.523735 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.523884 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.524032 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.524315 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.524471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.524612 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.524760 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.524931 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.525077 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.525229 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.525369 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.525541 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.525698 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.525840 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.525979 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.526160 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.526307 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.526480 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.526635 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.526777 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.526917 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.527177 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.527332 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.527483 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.527738 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.527886 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.528135 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.528321 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.528466 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.528742 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.528888 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.529057 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.529387 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.529532 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.529683 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.529944 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.530092 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.530268 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.530415 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.530608 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.530752 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.530901 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.531048 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.531188 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.531521 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.531970 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.532677 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.532677 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.532867 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.533021 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.533243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.534405 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.534574 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.534767 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.534939 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.535203 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.535525 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.535711 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.535863 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.536175 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.536322 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.536510 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.536792 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.536938 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.537142 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.537365 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.537525 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.537711 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.537867 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.538087 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.538238 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.538379 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.538539 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.538689 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.538831 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.539001 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.539148 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.539338 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.539534 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.539758 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.539901 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.540040 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.540179 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.540331 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.540597 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.540927 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.541347 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.541679 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.541997 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.542328 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.542473 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.542657 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.542836 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.542982 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.543262 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.543423 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.543636 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.543794 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.543935 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.544076 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.544229 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.544371 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.544597 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.544744 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.544899 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.545040 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.545190 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.545331 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.545478 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.545625 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.545777 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.545917 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.546066 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.546207 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.546347 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.546510 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.546657 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.546829 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.546984 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.547133 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.547276 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.547459 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.547635 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.547810 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.547952 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.548091 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.548232 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.548403 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.548550 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.548735 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.548883 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.549049 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.549195 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.549368 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.549569 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.549732 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.550392 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.550533 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.550672 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.550887 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.551041 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.551201 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.551350 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.551497 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.551728 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.551878 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.552071 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.552221 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.552368 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.552533 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.552681 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.552827 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.552986 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.553140 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.553288 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.553442 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.553598 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.553751 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.553909 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.554057 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.554247 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.554403 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.554575 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.554796 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.554962 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.555109 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.555265 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.555412 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.555579 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.555743 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.555900 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.556049 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.556194 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.556347 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.556504 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.556665 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.556814 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.556959 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.557105 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.557260 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.557408 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.557563 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.557687 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.557796 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.557882 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.558011 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.558109 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.558324 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.558414 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.558630 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.558718 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.558986 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.559163 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.559247 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.559327 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.559568 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.559686 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.559886 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.559982 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.560213 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.560309 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.560526 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.560612 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.560836 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.560936 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.561147 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.561304 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.561460 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.561607 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.561788 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.561993 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.562142 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.562417 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.562577 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.562724 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.562934 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.563087 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.563267 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.563419 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.563610 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.563766 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.563929 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.564086 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.564242 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.564389 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.564617 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.564785 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.565016 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.565199 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.565526 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.565681 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.565859 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.566012 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.566172 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.566320 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.566489 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.566831 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.567339 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.567618 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.567803 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.567956 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.568129 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.568282 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.568458 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.568621 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.568794 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.569272 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.569748 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.569908 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.570117 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.570291 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.570440 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.570594 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.570741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.570887 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.571064 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.571226 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.571374 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.571521 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.571734 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.571888 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.572077 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.572241 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.572389 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.572535 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.572706 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.572859 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.573014 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.573162 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.573331 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.573485 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.573692 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.573858 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.574007 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.574165 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.574320 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.574469 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.574616 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.574776 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.574931 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.575160 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.575312 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.575475 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.575653 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.575818 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.576021 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.576180 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.576337 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.576491 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.576648 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.576795 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.576949 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.577097 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.577255 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.577402 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.577557 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.577713 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.577862 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.578017 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.578164 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.578318 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.578464 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.578610 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.578763 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.578910 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.579056 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.579282 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.579437 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.579644 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.579799 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.579954 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.579954 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.580251 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.580398 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.580544 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.580689 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.580864 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.581018 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.581165 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.581310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.581456 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.581601 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.581754 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.581922 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.582069 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.582222 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.582367 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.582520 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.582667 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.582821 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.582969 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.583115 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.583260 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.583405 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.583589 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.583759 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.583926 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.584081 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.584228 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.584374 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.584529 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.584676 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.584829 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.584976 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.585122 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.585364 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.585525 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.585674 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.585819 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.585975 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.586122 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.586268 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.586426 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.586580 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.586735 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.586883 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.587037 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.587192 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.587374 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.587528 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.587713 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.587961 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.588114 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.588271 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.588419 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.588564 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.588716 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.588899 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.589050 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.589206 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.589419 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.589571 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.589726 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.589873 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.590038 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.590196 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.590351 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.590498 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.590643 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.590797 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.590945 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.591100 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.591249 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.591395 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.591574 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.591731 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.591889 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.592054 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.592210 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.592358 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.592511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.592658 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.592813 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.592968 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.593115 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.593262 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.593416 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.593571 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.593731 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.593889 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.594034 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.594179 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.594332 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.594481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.594636 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.594783 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.594937 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.595084 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.595229 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.595400 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.595644 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.595798 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.595955 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.596101 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.596316 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.596995 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.597143 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.597289 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.597434 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.597581 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.597733 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.597959 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.598109 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.598256 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.598410 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.598572 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.598718 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.598873 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.599020 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.599166 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.599317 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.599464 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.599677 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.599837 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.599985 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.600139 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.600287 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.600433 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.600598 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.600747 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.600893 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.600893 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.601186 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.601340 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.601496 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.601643 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.601802 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.601902 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.601988 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.602081 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.602176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.602259 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.602338 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.602584 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.602795 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.602895 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.603132 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.603221 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.603456 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.603575 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.603824 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.603939 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.604136 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.604232 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.604449 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.604536 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.604755 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.604850 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.605062 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.605149 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.605371 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.605457 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.605685 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.605773 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.605994 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.606081 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.606305 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.606391 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.606614 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.606702 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.606923 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.607009 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.607237 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.607331 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.607566 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.607658 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.607886 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.607990 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.608201 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.608309 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.608510 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.608597 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.608821 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.608907 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.609132 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.609227 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.609442 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.609528 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.609751 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.609836 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.610062 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.610158 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.610379 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.610467 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.610706 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.610792 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.611021 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.611115 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.611330 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.611417 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.611662 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.611771 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.612561 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.612659 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.612894 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.612981 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.613210 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.613304 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.613529 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.613617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.613868 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.614046 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.614205 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.614356 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.614513 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.614671 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.614852 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.615004 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.615150 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.615309 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.615486 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.615672 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.615909 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.616071 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.616219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.616375 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.616524 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.616678 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.616836 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.616984 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.617130 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.617286 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.617441 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.617587 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.617733 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.617879 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.618033 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.618188 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.618336 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.618482 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.618638 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.618826 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.618992 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.619140 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.619286 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.619431 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.619608 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.619760 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.619920 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.620067 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.620249 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.620402 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.620556 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.620723 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.620871 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.621016 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.621161 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.621306 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.621453 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.621607 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.621755 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.621926 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.622077 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.622223 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.622369 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.622523 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.622682 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.622828 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.622973 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.623119 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.623274 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.623433 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.623664 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.623816 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.623962 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.624148 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.624303 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.624459 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.624617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.624763 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.624909 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.625054 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.625208 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.625364 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.625511 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.625657 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.625809 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.626038 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.626201 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.626348 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.626494 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.626649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.626796 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.626943 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.626943 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.627302 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.627456 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.627648 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.627648 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.627945 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.628093 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.628239 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.628384 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.628529 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.628686 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.628845 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.629003 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.629158 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.629305 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.629451 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.629596 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.629751 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.629897 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.630052 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.630206 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.630353 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.630509 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.630664 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.630812 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.630957 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.631104 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.631249 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.631403 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.631569 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.631721 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.631869 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.632015 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.632161 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.632318 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.632475 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.632623 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.632775 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.632923 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.633069 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.633225 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.633372 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.633518 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.633664 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.633810 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.633964 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.634111 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.634268 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.634415 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.634560 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.634706 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.634860 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.635007 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.635153 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.635299 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.635446 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.635620 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.635785 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.635942 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.636180 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.636343 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.636491 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.636646 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.636794 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.636954 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.637101 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.637247 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.637393 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.637552 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.637699 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.637853 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.638000 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.638157 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.638303 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.638303 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.638596 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.638751 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.638898 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.639055 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.639203 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.639358 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.639513 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.639513 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.639815 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.639972 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:06:01.640134 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.640134 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.640422 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.640576 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.640837 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.641154 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.641471 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.641780 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:06:01.642026 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:06:01.792246 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO dbcounter [None req-377592cb-07c3-4a19-b112-fc986263108b None None] Registered counter for database nova_api Jul 25 12:06:01.794792 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO dbcounter [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Registered counter for database nova_api Jul 25 12:06:01.812631 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG oslo_db.sqlalchemy.engines [None req-377592cb-07c3-4a19-b112-fc986263108b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:06:01.814905 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_db.sqlalchemy.engines [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:06:01.819229 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writer thread running {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:06:01.821511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writer thread running {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:06:01.884214 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.context [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bd86971f-66ee-4017-8a4d-2ac53750a8a3(cell1) {{(pid=103269) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 12:06:01.884437 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.context [None req-377592cb-07c3-4a19-b112-fc986263108b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bd86971f-66ee-4017-8a4d-2ac53750a8a3(cell1) {{(pid=103270) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 12:06:01.888125 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:06:01.889702 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:06:01.890058 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG oslo_concurrency.lockutils [None req-377592cb-07c3-4a19-b112-fc986263108b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:06:01.890695 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:06:01.892694 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:06:01.893774 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG oslo_concurrency.lockutils [None req-377592cb-07c3-4a19-b112-fc986263108b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:06:01.894574 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG oslo_concurrency.lockutils [None req-377592cb-07c3-4a19-b112-fc986263108b None None] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:06:01.894948 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO dbcounter [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Registered counter for database nova_cell0 Jul 25 12:06:01.896593 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG oslo_concurrency.lockutils [None req-377592cb-07c3-4a19-b112-fc986263108b None None] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:06:01.898674 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO dbcounter [None req-377592cb-07c3-4a19-b112-fc986263108b None None] Registered counter for database nova_cell0 Jul 25 12:06:01.900416 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO dbcounter [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Registered counter for database nova_cell1 Jul 25 12:06:01.904225 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO dbcounter [None req-377592cb-07c3-4a19-b112-fc986263108b None None] Registered counter for database nova_cell1 Jul 25 12:06:01.908020 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_db.sqlalchemy.engines [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:06:01.911748 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_db.sqlalchemy.engines [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:06:01.914824 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG oslo_db.sqlalchemy.engines [None req-377592cb-07c3-4a19-b112-fc986263108b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:06:01.916547 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG oslo_db.sqlalchemy.engines [None req-377592cb-07c3-4a19-b112-fc986263108b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:06:01.917721 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writer thread running {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:06:01.919202 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writer thread running {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:06:01.922515 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writer thread running {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:06:01.924828 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writer thread running {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:06:02.061671 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO dbcounter [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Registered counter for database nova_cell0 Jul 25 12:06:02.070721 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_db.sqlalchemy.engines [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:06:02.075132 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writer thread running {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:06:02.076229 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO dbcounter [None req-377592cb-07c3-4a19-b112-fc986263108b None None] Registered counter for database nova_cell0 Jul 25 12:06:02.083689 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG oslo_db.sqlalchemy.engines [None req-377592cb-07c3-4a19-b112-fc986263108b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:06:02.088347 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writer thread running {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:06:02.417366 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: WARNING keystonemiddleware.auth_token [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:06:02.424659 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: WARNING keystonemiddleware.auth_token [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:06:02.428391 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: WARNING keystonemiddleware.auth_token [None req-377592cb-07c3-4a19-b112-fc986263108b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:06:02.435560 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: WARNING keystonemiddleware.auth_token [None req-377592cb-07c3-4a19-b112-fc986263108b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:06:02.765233 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: WARNING keystonemiddleware.auth_token [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:06:02.771616 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: WARNING keystonemiddleware.auth_token [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:06:02.776887 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b63165f9c0 pid: 103269 (default app) Jul 25 12:06:02.779302 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:06:02.780129 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001735 Jul 25 12:06:02.780548 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: WARNING keystonemiddleware.auth_token [None req-377592cb-07c3-4a19-b112-fc986263108b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:06:02.780675 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Mon Jul 25 12:06:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:06:02.787300 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: WARNING keystonemiddleware.auth_token [None req-377592cb-07c3-4a19-b112-fc986263108b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:06:02.792704 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b63165f9c0 pid: 103270 (default app) Jul 25 12:07:18.128965 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:18.129965 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jul 25 12:07:18.130391 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:07:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:07:18.142704 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writing DB stats nova_api:SELECT=3 {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:18.143816 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writing DB stats nova_cell1:SELECT=3 {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:18.144997 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writing DB stats nova_cell0:SELECT=3 {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:18.145994 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:19.016898 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-1c0c250a-5630-402b-96f6-7759b4a02f4e admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:19.049785 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-1c0c250a-5630-402b-96f6-7759b4a02f4e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.912806 Jul 25 12:07:19.050574 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Mon Jul 25 12:07:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:07:21.332867 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:21.333873 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-393549eb-7341-4103-b5cd-1f11877f1fe1 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 25 12:07:21.334269 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:07:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:07:21.782029 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-7462642e-d2a5-479d-bb60-76a04d7c2d8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "disk": 1}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:21.803012 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:07:21.803012 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: warnings.warn(msg) Jul 25 12:07:21.832639 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-7462642e-d2a5-479d-bb60-76a04d7c2d8a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.491944 Jul 25 12:07:21.840677 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 25 12:07:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:07:21.847911 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=3 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:21.848965 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell1:SELECT=3 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:21.850159 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell0:SELECT=3 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:21.851446 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:22.052338 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-56fd4645-b599-4b9f-916f-98b5c9860a75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:22.056654 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:07:22.056654 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jul 25 12:07:22.118123 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-56fd4645-b599-4b9f-916f-98b5c9860a75 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.275784 Jul 25 12:07:22.118954 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jul 25 12:07:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:07:24.326842 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-7462642e-d2a5-479d-bb60-76a04d7c2d8a admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:24.327904 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-7462642e-d2a5-479d-bb60-76a04d7c2d8a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 25 12:07:24.328461 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:07:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:07:24.991867 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-aed4b759-9f02-4391-92cf-d2a3d50c9006 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "swap": 0, "name": "ds512M", "vcpus": 1}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:25.013735 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:07:25.013735 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jul 25 12:07:25.036079 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-aed4b759-9f02-4391-92cf-d2a3d50c9006 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.701525 Jul 25 12:07:25.037241 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 25 12:07:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:07:25.050926 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-ed7a11df-432f-4b2c-bcca-5c017fa8e07a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:25.054454 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:07:25.054454 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: warnings.warn(msg) Jul 25 12:07:25.092651 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-ed7a11df-432f-4b2c-bcca-5c017fa8e07a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045718 Jul 25 12:07:25.093578 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jul 25 12:07:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:07:27.304068 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-aed4b759-9f02-4391-92cf-d2a3d50c9006 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:27.305305 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-aed4b759-9f02-4391-92cf-d2a3d50c9006 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001843 Jul 25 12:07:27.305773 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:07:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:07:27.742241 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-7bab3d0d-6f87-4994-acfe-12d7691c6251 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "ram": 1024}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:27.761597 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-7bab3d0d-6f87-4994-acfe-12d7691c6251 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449371 Jul 25 12:07:27.763690 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 25 12:07:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:07:27.774287 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-28f02f83-edb4-4f2f-bcb9-0552bf98e70d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:27.800050 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-28f02f83-edb4-4f2f-bcb9-0552bf98e70d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029591 Jul 25 12:07:27.800624 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jul 25 12:07:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:07:30.017406 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-7bab3d0d-6f87-4994-acfe-12d7691c6251 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:30.018423 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-7bab3d0d-6f87-4994-acfe-12d7691c6251 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 25 12:07:30.019011 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:07:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:07:30.452213 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-ed6f848a-40eb-42f3-a0d6-f6be4735ba30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "disk": 10, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:30.479661 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-ed6f848a-40eb-42f3-a0d6-f6be4735ba30 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450546 Jul 25 12:07:30.480218 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 25 12:07:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:07:30.495244 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-d8e24b67-3ea7-4f98-b6d7-f16a2abeffb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:30.530000 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-d8e24b67-3ea7-4f98-b6d7-f16a2abeffb9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038353 Jul 25 12:07:30.530507 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jul 25 12:07:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:07:32.756022 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-ed6f848a-40eb-42f3-a0d6-f6be4735ba30 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:32.757086 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-ed6f848a-40eb-42f3-a0d6-f6be4735ba30 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jul 25 12:07:32.757643 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:07:33.187338 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-2349d01d-86a1-4f49-b12f-084ce0ef8c90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:33.206395 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-2349d01d-86a1-4f49-b12f-084ce0ef8c90 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442907 Jul 25 12:07:33.207045 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 25 12:07:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:07:33.219815 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-91a1db59-f29f-4bf4-8ff5-44971a0923e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:33.246762 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-91a1db59-f29f-4bf4-8ff5-44971a0923e7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030640 Jul 25 12:07:33.247408 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Mon Jul 25 12:07:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:07:35.709592 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-2349d01d-86a1-4f49-b12f-084ce0ef8c90 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:35.710628 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-2349d01d-86a1-4f49-b12f-084ce0ef8c90 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 25 12:07:35.711027 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:07:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:07:36.154319 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-29da24ea-662b-4df1-9b4a-c23034f3fc98 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:36.178161 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-29da24ea-662b-4df1-9b4a-c23034f3fc98 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.459651 Jul 25 12:07:36.178649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Mon Jul 25 12:07:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:07:38.395907 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-2349d01d-86a1-4f49-b12f-084ce0ef8c90 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:38.396841 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-2349d01d-86a1-4f49-b12f-084ce0ef8c90 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 25 12:07:38.397720 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:07:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:07:38.816517 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-2a4db638-e679-4f0c-bf51-20dd1b05966a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:38.834832 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-2a4db638-e679-4f0c-bf51-20dd1b05966a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.431165 Jul 25 12:07:38.835387 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 25 12:07:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:07:38.847244 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-feee5c48-6788-43e1-bb89-b19fd58d26d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:38.871740 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-feee5c48-6788-43e1-bb89-b19fd58d26d4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028072 Jul 25 12:07:38.872327 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jul 25 12:07:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:07:41.046121 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-2a4db638-e679-4f0c-bf51-20dd1b05966a admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:41.047143 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-2a4db638-e679-4f0c-bf51-20dd1b05966a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 25 12:07:41.047566 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:07:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:07:41.448024 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-c952f6ab-2397-4ed2-8f64-d13d2fba008d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:41.469181 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-c952f6ab-2397-4ed2-8f64-d13d2fba008d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.415804 Jul 25 12:07:41.469936 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 25 12:07:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:07:41.482281 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-0b22bc2f-6b22-453f-b5f2-dc8e386bfa85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:41.505772 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-0b22bc2f-6b22-453f-b5f2-dc8e386bfa85 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027210 Jul 25 12:07:41.506420 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jul 25 12:07:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:07:43.700393 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-c952f6ab-2397-4ed2-8f64-d13d2fba008d admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:43.701413 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-c952f6ab-2397-4ed2-8f64-d13d2fba008d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jul 25 12:07:43.701828 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:07:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:07:44.109225 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-310dd4da-6836-48a4-8c0f-bce50887d1ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:44.128269 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-310dd4da-6836-48a4-8c0f-bce50887d1ca admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.419838 Jul 25 12:07:44.128816 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 25 12:07:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:07:44.141225 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-4d72b289-a2e4-43b6-a856-a145aedb2578 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:44.165696 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-4d72b289-a2e4-43b6-a856-a145aedb2578 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027900 Jul 25 12:07:44.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jul 25 12:07:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:07:46.408128 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-310dd4da-6836-48a4-8c0f-bce50887d1ca admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:46.409904 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-310dd4da-6836-48a4-8c0f-bce50887d1ca admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002264 Jul 25 12:07:46.410376 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:07:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:07:46.861418 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-89eb7a31-3f42-455e-8ffa-cd5386e31790 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "ram": 8192, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:46.884244 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-89eb7a31-3f42-455e-8ffa-cd5386e31790 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.467324 Jul 25 12:07:46.884793 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 25 12:07:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:07:46.896663 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-712180e0-27f8-4432-a2cb-88b90c10f145 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:46.924309 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-712180e0-27f8-4432-a2cb-88b90c10f145 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031288 Jul 25 12:07:46.927714 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jul 25 12:07:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:07:49.115689 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-89eb7a31-3f42-455e-8ffa-cd5386e31790 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:07:49.116706 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-89eb7a31-3f42-455e-8ffa-cd5386e31790 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 25 12:07:49.117108 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:07:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:07:49.559232 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e1fd26e7-1ef7-465a-98ea-97793030266c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:49.582114 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-e1fd26e7-1ef7-465a-98ea-97793030266c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458709 Jul 25 12:07:49.582674 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Mon Jul 25 12:07:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:07:49.595177 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-8ee5a48b-7e5a-42c9-901b-6153a236632b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:07:49.600042 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:49.630127 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-8ee5a48b-7e5a-42c9-901b-6153a236632b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038546 Jul 25 12:07:49.630986 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Mon Jul 25 12:07:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:08:10.005264 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e1fd26e7-1ef7-465a-98ea-97793030266c admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:10.006301 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-e1fd26e7-1ef7-465a-98ea-97793030266c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 25 12:08:10.006699 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:08:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:08:10.395146 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-5722ad34-872a-4406-b219-b071b69cf613 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:10.412844 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-5722ad34-872a-4406-b219-b071b69cf613 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400097 Jul 25 12:08:10.413373 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Mon Jul 25 12:08:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:08:11.469028 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e1fd26e7-1ef7-465a-98ea-97793030266c admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:11.470039 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-e1fd26e7-1ef7-465a-98ea-97793030266c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 25 12:08:11.470471 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 25 12:08:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:08:11.989358 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-8e03e595-6230-452b-b0d3-8da56a07ddd1 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:11.995513 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.wsgi [None req-8e03e595-6230-452b-b0d3-8da56a07ddd1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-8e03e595-6230-452b-b0d3-8da56a07ddd1 admin admin] Request method failure captured: Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Accept: application/json Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Accept-Encoding: gzip, deflate Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Connection: keep-alive Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Content-Length: 0 Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Host: 10.222.0.42 Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Openstack-Api-Version: compute 2.90 Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Openstack-System-Scope: None Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: User-Agent: python-novaclient Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Auth-Token: gAAAAABi3oer3m_ROU5gOdwELhJ5DNheTZqkdk59dmh1Pp6UD-5GjbofKnTZsjueRsT_wdTF04wuZFNB_E6_2z_Hy374FZTsiWeDLiVjjAdq1tJajNNNBLbF_6A2SELt3o8UCrCd-UjA2jhe-R7JjR4Uaq4XynfAKj_sFGxawzbQKL9ipcW3cUE Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Domain-Id: None Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Domain-Name: None Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Identity-Status: Confirmed Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Is-Admin-Project: True Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Project-Domain-Id: default Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Project-Domain-Name: Default Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Project-Id: 827585a7cfe8411987f9b81102c1c103 Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Project-Name: admin Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Role: reader,member,admin Jul 25 12:08:11.998728 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Roles: reader,member,admin Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_827585a7cfe8411987f9b81102c1c103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Tenant: admin Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Tenant-Id: 827585a7cfe8411987f9b81102c1c103 Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Tenant-Name: admin Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User: admin Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User-Domain-Id: default Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User-Domain-Name: Default Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User-Id: 0fad2691baf0472d99015f9f123f8d32 Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User-Name: admin Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: method: > Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: exception: Flavor 42 could not be found. Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: action_args: {'id': '42'} Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:08:12.000481 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:08:12.001471 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:12.002617 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-8e03e595-6230-452b-b0d3-8da56a07ddd1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:08:12.003782 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-8e03e595-6230-452b-b0d3-8da56a07ddd1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393337 Jul 25 12:08:12.003782 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Jul 25 12:08:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:12.010034 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-78335e28-6458-4f91-b1e2-1a027b32c944 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:12.014180 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:12.034390 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-78335e28-6458-4f91-b1e2-1a027b32c944 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028058 Jul 25 12:08:12.034928 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jul 25 12:08:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:08:12.045132 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-befa1219-acb9-4c44-b9fe-8295aa31d537 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:12.068336 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-befa1219-acb9-4c44-b9fe-8295aa31d537 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026736 Jul 25 12:08:12.068867 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jul 25 12:08:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:08:12.078085 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-ba15443a-84c4-424b-8015-3164c92ae214 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:12.084625 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.wsgi [None req-ba15443a-84c4-424b-8015-3164c92ae214 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-ba15443a-84c4-424b-8015-3164c92ae214 admin admin] Request method failure captured: Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Accept: application/json Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Accept-Encoding: gzip, deflate Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Connection: keep-alive Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Content-Length: 0 Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Host: 10.222.0.42 Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Openstack-Api-Version: compute 2.90 Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Openstack-System-Scope: None Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: User-Agent: python-novaclient Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Auth-Token: gAAAAABi3oer3m_ROU5gOdwELhJ5DNheTZqkdk59dmh1Pp6UD-5GjbofKnTZsjueRsT_wdTF04wuZFNB_E6_2z_Hy374FZTsiWeDLiVjjAdq1tJajNNNBLbF_6A2SELt3o8UCrCd-UjA2jhe-R7JjR4Uaq4XynfAKj_sFGxawzbQKL9ipcW3cUE Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Domain-Id: None Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Domain-Name: None Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Identity-Status: Confirmed Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Is-Admin-Project: True Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Project-Domain-Id: default Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Project-Domain-Name: Default Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Project-Id: 827585a7cfe8411987f9b81102c1c103 Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Project-Name: admin Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Role: reader,member,admin Jul 25 12:08:12.088440 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Roles: reader,member,admin Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_827585a7cfe8411987f9b81102c1c103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Tenant: admin Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Tenant-Id: 827585a7cfe8411987f9b81102c1c103 Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Tenant-Name: admin Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User: admin Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User-Domain-Id: default Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User-Domain-Name: Default Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User-Id: 0fad2691baf0472d99015f9f123f8d32 Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User-Name: admin Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: method: > Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: exception: Flavor 42 could not be found. Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: action_args: {'id': '42'} Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:08:12.089953 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:08:12.090804 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:12.091896 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-ba15443a-84c4-424b-8015-3164c92ae214 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:08:12.092871 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-ba15443a-84c4-424b-8015-3164c92ae214 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015313 Jul 25 12:08:12.092871 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Jul 25 12:08:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 12:08:13.054047 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-befa1219-acb9-4c44-b9fe-8295aa31d537 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:13.055550 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-befa1219-acb9-4c44-b9fe-8295aa31d537 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001906 Jul 25 12:08:13.055949 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 25 12:08:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:08:13.580551 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-27356178-72c0-45e0-8a5b-cfef80015692 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:13.586309 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.wsgi [None req-27356178-72c0-45e0-8a5b-cfef80015692 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-27356178-72c0-45e0-8a5b-cfef80015692 admin admin] Request method failure captured: Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Accept: application/json Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Accept-Encoding: gzip, deflate Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Connection: keep-alive Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Content-Length: 0 Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Host: 10.222.0.42 Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Openstack-Api-Version: compute 2.90 Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Openstack-System-Scope: None Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: User-Agent: python-novaclient Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Auth-Token: gAAAAABi3oesCCJ1XRuZUSrI6o4XxdBHlOXtAPCBDvskUvgcDAdD2Vpnco5GQa9Pijug3WnErrij4ykAskZ7EQWpB3Z9k6xJc88ygmke_zEOXp4G2WjYPDaJ-4FsKdQAbNTwLsGn91HhWylIQs2rCI7c30cmMtgTlnk4SeyJrRJNx0KraghULrg Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Domain-Id: None Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Domain-Name: None Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Identity-Status: Confirmed Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Is-Admin-Project: True Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Project-Domain-Id: default Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Project-Domain-Name: Default Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Project-Id: 827585a7cfe8411987f9b81102c1c103 Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Project-Name: admin Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Role: reader,member,admin Jul 25 12:08:13.587853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Roles: reader,member,admin Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_827585a7cfe8411987f9b81102c1c103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Tenant: admin Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Tenant-Id: 827585a7cfe8411987f9b81102c1c103 Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Tenant-Name: admin Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User: admin Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User-Domain-Id: default Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User-Domain-Name: Default Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User-Id: 0fad2691baf0472d99015f9f123f8d32 Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User-Name: admin Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: method: > Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: exception: Flavor 84 could not be found. Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: action_args: {'id': '84'} Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:08:13.589310 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:08:13.590243 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:13.591511 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-27356178-72c0-45e0-8a5b-cfef80015692 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:08:13.592853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-27356178-72c0-45e0-8a5b-cfef80015692 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396339 Jul 25 12:08:13.592853 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Jul 25 12:08:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:13.598888 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-ffeb4b18-84c9-4500-8346-0b5510289480 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:13.614194 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-ffeb4b18-84c9-4500-8346-0b5510289480 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018806 Jul 25 12:08:13.614657 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jul 25 12:08:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:08:13.623780 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-132daa5b-5a7c-44ad-a1e2-c7abfbbd7881 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:13.639875 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-132daa5b-5a7c-44ad-a1e2-c7abfbbd7881 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019528 Jul 25 12:08:13.640395 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jul 25 12:08:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:08:13.650071 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-c2e2d068-ab2a-4f7b-964d-797db6e332b6 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:13.655718 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.wsgi [None req-c2e2d068-ab2a-4f7b-964d-797db6e332b6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-c2e2d068-ab2a-4f7b-964d-797db6e332b6 admin admin] Request method failure captured: Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Accept: application/json Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Accept-Encoding: gzip, deflate Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Connection: keep-alive Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Content-Length: 0 Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Host: 10.222.0.42 Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Openstack-Api-Version: compute 2.90 Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Openstack-System-Scope: None Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: User-Agent: python-novaclient Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Auth-Token: gAAAAABi3oesCCJ1XRuZUSrI6o4XxdBHlOXtAPCBDvskUvgcDAdD2Vpnco5GQa9Pijug3WnErrij4ykAskZ7EQWpB3Z9k6xJc88ygmke_zEOXp4G2WjYPDaJ-4FsKdQAbNTwLsGn91HhWylIQs2rCI7c30cmMtgTlnk4SeyJrRJNx0KraghULrg Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Domain-Id: None Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Domain-Name: None Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Identity-Status: Confirmed Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Is-Admin-Project: True Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Project-Domain-Id: default Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Project-Domain-Name: Default Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Project-Id: 827585a7cfe8411987f9b81102c1c103 Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Project-Name: admin Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Role: reader,member,admin Jul 25 12:08:13.657210 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Roles: reader,member,admin Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_827585a7cfe8411987f9b81102c1c103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Tenant: admin Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Tenant-Id: 827585a7cfe8411987f9b81102c1c103 Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Tenant-Name: admin Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User: admin Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User-Domain-Id: default Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User-Domain-Name: Default Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User-Id: 0fad2691baf0472d99015f9f123f8d32 Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User-Name: admin Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: method: > Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: exception: Flavor 84 could not be found. Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: action_args: {'id': '84'} Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:08:13.658701 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:08:13.659741 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:13.661176 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-c2e2d068-ab2a-4f7b-964d-797db6e332b6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:08:13.662403 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-c2e2d068-ab2a-4f7b-964d-797db6e332b6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012525 Jul 25 12:08:13.662403 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Jul 25 12:08:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:14.630898 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-132daa5b-5a7c-44ad-a1e2-c7abfbbd7881 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:14.631932 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-132daa5b-5a7c-44ad-a1e2-c7abfbbd7881 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 25 12:08:14.632957 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 25 12:08:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:08:15.153815 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-2e4fffdd-c10c-4ca6-8db7-c67f6066d141 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:15.159461 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.wsgi [None req-2e4fffdd-c10c-4ca6-8db7-c67f6066d141 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-2e4fffdd-c10c-4ca6-8db7-c67f6066d141 admin admin] Request method failure captured: Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Accept: application/json Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Accept-Encoding: gzip, deflate Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Connection: keep-alive Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Content-Length: 0 Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Host: 10.222.0.42 Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Openstack-Api-Version: compute 2.90 Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Openstack-System-Scope: None Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: User-Agent: python-novaclient Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Auth-Token: gAAAAABi3oeuDbE_lMLEPw0AtUD_Cam9Qy6GGggF4ChjdkBKdiRUOu3XdKT925A0VJKZ_XOUCfq_9QvfraCXVI1p7NQWzx2roSfoPLXEnd6Eg9qvPnrXgbh_3kLQSvdg8D_lA6T15MANiEeU0-s1qNSZl6PIvwOM5kLkTwAZBU5FhkkWMAKtXqs Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Domain-Id: None Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Domain-Name: None Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Identity-Status: Confirmed Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Is-Admin-Project: True Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Project-Domain-Id: default Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Project-Domain-Name: Default Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Project-Id: 827585a7cfe8411987f9b81102c1c103 Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Project-Name: admin Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Role: reader,member,admin Jul 25 12:08:15.160980 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Roles: reader,member,admin Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_827585a7cfe8411987f9b81102c1c103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Tenant: admin Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Tenant-Id: 827585a7cfe8411987f9b81102c1c103 Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-Tenant-Name: admin Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User: admin Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User-Domain-Id: default Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User-Domain-Name: Default Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User-Id: 0fad2691baf0472d99015f9f123f8d32 Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: X-User-Name: admin Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: method: > Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: exception: Flavor 451 could not be found. Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: action_args: {'id': '451'} Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:08:15.162531 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:08:15.163595 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: ERROR nova.api.openstack.wsgi Jul 25 12:08:15.166484 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-2e4fffdd-c10c-4ca6-8db7-c67f6066d141 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:08:15.168542 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-2e4fffdd-c10c-4ca6-8db7-c67f6066d141 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391631 Jul 25 12:08:15.168542 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jul 25 12:08:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:15.172579 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-49a2b776-59f9-4866-8b44-cc6040b577f1 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:15.187145 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-49a2b776-59f9-4866-8b44-cc6040b577f1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018109 Jul 25 12:08:15.187687 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jul 25 12:08:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:08:15.196942 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:15.212009 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018520 Jul 25 12:08:15.212526 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Jul 25 12:08:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:08:15.221301 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-6740aaa6-7915-4b1b-87cd-0211cc427b88 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:15.227141 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.wsgi [None req-6740aaa6-7915-4b1b-87cd-0211cc427b88 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-6740aaa6-7915-4b1b-87cd-0211cc427b88 admin admin] Request method failure captured: Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Accept: application/json Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Accept-Encoding: gzip, deflate Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Connection: keep-alive Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Content-Length: 0 Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Host: 10.222.0.42 Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Openstack-Api-Version: compute 2.90 Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Openstack-System-Scope: None Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: User-Agent: python-novaclient Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Auth-Token: gAAAAABi3oeuDbE_lMLEPw0AtUD_Cam9Qy6GGggF4ChjdkBKdiRUOu3XdKT925A0VJKZ_XOUCfq_9QvfraCXVI1p7NQWzx2roSfoPLXEnd6Eg9qvPnrXgbh_3kLQSvdg8D_lA6T15MANiEeU0-s1qNSZl6PIvwOM5kLkTwAZBU5FhkkWMAKtXqs Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Domain-Id: None Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Domain-Name: None Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Identity-Status: Confirmed Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Is-Admin-Project: True Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Project-Domain-Id: default Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Project-Domain-Name: Default Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Project-Id: 827585a7cfe8411987f9b81102c1c103 Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Project-Name: admin Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Role: reader,member,admin Jul 25 12:08:15.228649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Roles: reader,member,admin Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_827585a7cfe8411987f9b81102c1c103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/827585a7cfe8411987f9b81102c1c103"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Tenant: admin Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Tenant-Id: 827585a7cfe8411987f9b81102c1c103 Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-Tenant-Name: admin Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User: admin Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User-Domain-Id: default Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User-Domain-Name: Default Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User-Id: 0fad2691baf0472d99015f9f123f8d32 Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: X-User-Name: admin Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: method: > Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: exception: Flavor 451 could not be found. Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: action_args: {'id': '451'} Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:08:15.230219 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:08:15.231294 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jul 25 12:08:15.232652 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-6740aaa6-7915-4b1b-87cd-0211cc427b88 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:08:15.233943 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-6740aaa6-7915-4b1b-87cd-0211cc427b88 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012114 Jul 25 12:08:15.233943 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jul 25 12:08:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 12:08:16.208181 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:16.209194 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 25 12:08:16.209593 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 25 12:08:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:08:16.734258 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-b4a9cbc7-b33a-4cb8-b8f2-d1d1080bbc43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:08:16.752624 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-b4a9cbc7-b33a-4cb8-b8f2-d1d1080bbc43 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.402350 Jul 25 12:08:16.753245 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Jul 25 12:08:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:08:17.726897 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:17.727973 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Jul 25 12:08:17.728376 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 25 12:08:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:08:18.246680 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-158c94ed-f771-4331-b1cc-0d61a0e453c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:08:18.265379 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-158c94ed-f771-4331-b1cc-0d61a0e453c7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.400105 Jul 25 12:08:18.265926 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Jul 25 12:08:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:08:19.239398 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:19.240450 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 25 12:08:19.240843 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 25 12:08:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:08:19.765620 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-524a3153-b32c-47d7-abab-b1e056624b4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:08:19.789571 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-524a3153-b32c-47d7-abab-b1e056624b4b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.411357 Jul 25 12:08:19.790188 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Jul 25 12:08:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:08:20.806372 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:20.807370 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 25 12:08:20.807808 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 25 12:08:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:08:21.331448 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-0bce42a7-67c2-488b-92a7-48443dfc731b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:08:21.349235 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-0bce42a7-67c2-488b-92a7-48443dfc731b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.400231 Jul 25 12:08:21.349771 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Jul 25 12:08:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:08:22.329343 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:22.330344 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jul 25 12:08:22.330737 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 25 12:08:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:08:22.855332 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-c9dd6eaf-b686-4636-a53b-fa8c009ca1a7 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:08:22.875934 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-c9dd6eaf-b686-4636-a53b-fa8c009ca1a7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408040 Jul 25 12:08:22.876467 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Mon Jul 25 12:08:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:09:14.021797 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:09:14.022801 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-373b8478-3eb6-4d47-a718-4d1d8a580c4b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 25 12:09:14.023195 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Mon Jul 25 12:09:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:09:14.034337 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:14.411997 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-91e66a5d-231f-4ed8-8b88-88d5ae15bfc9 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:09:14.432238 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-91e66a5d-231f-4ed8-8b88-88d5ae15bfc9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402550 Jul 25 12:09:14.432704 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Mon Jul 25 12:09:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:09:14.456347 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-2463d883-bc90-42b7-94e5-1c0760135ea2 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:09:14.459842 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG dbcounter [-] [103270] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:14.466310 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-2463d883-bc90-42b7-94e5-1c0760135ea2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013607 Jul 25 12:09:14.466850 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Mon Jul 25 12:09:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:09:14.478292 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e53ee785-ecb8-44b7-b0dc-a5cfc0e3b438 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:09:14.485835 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-e53ee785-ecb8-44b7-b0dc-a5cfc0e3b438 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011100 Jul 25 12:09:14.486356 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Mon Jul 25 12:09:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:09:14.497823 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-7a1a6cb0-c16b-4c9a-bb93-9d7366815749 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:09:14.505688 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-7a1a6cb0-c16b-4c9a-bb93-9d7366815749 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011895 Jul 25 12:09:14.506239 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Mon Jul 25 12:09:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:09:14.518091 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-15bf177c-4776-4a8f-a091-733794233e23 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:09:14.525692 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-15bf177c-4776-4a8f-a091-733794233e23 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011106 Jul 25 12:09:14.526201 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Mon Jul 25 12:09:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:12:37.162722 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-7a1a6cb0-c16b-4c9a-bb93-9d7366815749 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:12:37.163779 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-7a1a6cb0-c16b-4c9a-bb93-9d7366815749 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 25 12:12:37.164173 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 25 12:12:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:12:37.306742 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=6 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:12:37.461360 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-d77bdd9e-ff6c-4ae1-b2d9-44c42879e9cc admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:12:37.464202 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:12:37.464202 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jul 25 12:12:37.465410 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-d77bdd9e-ff6c-4ae1-b2d9-44c42879e9cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:12:37.465854 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-d77bdd9e-ff6c-4ae1-b2d9-44c42879e9cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:12:37.466635 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-d77bdd9e-ff6c-4ae1-b2d9-44c42879e9cc admin admin] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:12:37.467062 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-d77bdd9e-ff6c-4ae1-b2d9-44c42879e9cc admin admin] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:12:37.500566 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-d77bdd9e-ff6c-4ae1-b2d9-44c42879e9cc admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.195937 Jul 25 12:12:37.501120 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jul 25 12:12:37 2022] GET /compute/v2.1/os-services => generated 794 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:12:38.330413 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-7a1a6cb0-c16b-4c9a-bb93-9d7366815749 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:12:38.331469 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-7a1a6cb0-c16b-4c9a-bb93-9d7366815749 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 25 12:12:38.331871 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 25 12:12:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:12:38.522649 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-0986bbe5-f6eb-44c1-969d-78b39537eb7f admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:12:38.525026 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:12:38.525026 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jul 25 12:12:38.526212 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-0986bbe5-f6eb-44c1-969d-78b39537eb7f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:12:38.526688 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-0986bbe5-f6eb-44c1-969d-78b39537eb7f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:12:38.527471 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-0986bbe5-f6eb-44c1-969d-78b39537eb7f admin admin] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:12:38.527924 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-0986bbe5-f6eb-44c1-969d-78b39537eb7f admin admin] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:12:38.547958 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-0986bbe5-f6eb-44c1-969d-78b39537eb7f admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077330 Jul 25 12:12:38.548509 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jul 25 12:12:38 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:12:49.780871 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-7a1a6cb0-c16b-4c9a-bb93-9d7366815749 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:12:49.781662 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-7a1a6cb0-c16b-4c9a-bb93-9d7366815749 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 25 12:12:49.782068 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 25 12:12:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:12:49.928026 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell0:SELECT=4 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:12:49.928730 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell1:SELECT=4 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:12:49.929405 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=8 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:12:49.984372 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-312b64de-a555-4eae-970f-2dedcf56fe5e admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:12:49.986751 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:12:49.986751 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jul 25 12:12:49.987962 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-312b64de-a555-4eae-970f-2dedcf56fe5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:12:49.988431 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-312b64de-a555-4eae-970f-2dedcf56fe5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:12:49.989280 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-312b64de-a555-4eae-970f-2dedcf56fe5e admin admin] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:12:49.989647 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-312b64de-a555-4eae-970f-2dedcf56fe5e admin admin] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:12:50.014692 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-312b64de-a555-4eae-970f-2dedcf56fe5e admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.091062 Jul 25 12:12:50.015237 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jul 25 12:12:49 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:12:50.844888 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: DEBUG nova.api.openstack.wsgi [None req-7a1a6cb0-c16b-4c9a-bb93-9d7366815749 admin admin] Calling method '>' {{(pid=103270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:12:50.845895 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: INFO nova.api.openstack.requestlog [None req-7a1a6cb0-c16b-4c9a-bb93-9d7366815749 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 25 12:12:50.846292 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: [pid: 103270|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Jul 25 12:12:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:12:51.035977 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-eea5f7d2-ee50-47d6-9a20-a2f297c80608 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:12:51.038568 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:12:51.038568 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jul 25 12:12:51.039781 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-eea5f7d2-ee50-47d6-9a20-a2f297c80608 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:12:51.040257 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-eea5f7d2-ee50-47d6-9a20-a2f297c80608 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:12:51.041065 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-eea5f7d2-ee50-47d6-9a20-a2f297c80608 admin admin] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:12:51.041493 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-eea5f7d2-ee50-47d6-9a20-a2f297c80608 admin admin] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:12:51.063182 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-eea5f7d2-ee50-47d6-9a20-a2f297c80608 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078644 Jul 25 12:12:51.063748 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Jul 25 12:12:50 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:13:48.028623 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: Mon Jul 25 12:13:48 2022 - graceful shutdown triggered... Jul 25 12:13:48.029175 dv-cinder-797608-61-iscsi devstack@n-api.service[103270]: Gracefully killing worker 2 (pid: 103270)... Jul 25 12:13:48.029560 dv-cinder-797608-61-iscsi devstack@n-api.service[103269]: Gracefully killing worker 1 (pid: 103269)... Jul 25 12:13:48.034934 dv-cinder-797608-61-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 12:13:49.029855 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: worker 1 buried after 1 seconds Jul 25 12:13:49.029855 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: worker 2 buried after 1 seconds Jul 25 12:13:49.029855 dv-cinder-797608-61-iscsi devstack@n-api.service[103268]: goodbye to uWSGI. Jul 25 12:13:49.031465 dv-cinder-797608-61-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 25 12:13:49.032069 dv-cinder-797608-61-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 12:13:49.034851 dv-cinder-797608-61-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 12:13:49.045073 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 12:13:49.047085 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 12:13:49 2022] *** Jul 25 12:13:49.047085 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 12:13:49.047085 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 12:13:49.047085 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: nodename: dv-cinder-797608-61-iscsi Jul 25 12:13:49.047085 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: machine: x86_64 Jul 25 12:13:49.047085 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: clock source: unix Jul 25 12:13:49.047085 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: pcre jit disabled Jul 25 12:13:49.047085 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: detected number of CPU cores: 4 Jul 25 12:13:49.047085 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: current working directory: / Jul 25 12:13:49.047085 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: detected binary path: /usr/bin/uwsgi-core Jul 25 12:13:49.047837 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: your processes number limit is 47680 Jul 25 12:13:49.047837 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: your memory page size is 4096 bytes Jul 25 12:13:49.047837 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: detected max file descriptor number: 2048 Jul 25 12:13:49.047837 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: lock engine: pthread robust mutexes Jul 25 12:13:49.047837 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: thunder lock: enabled Jul 25 12:13:49.047837 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 12:13:49.047837 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 12:13:49.087643 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: Python main interpreter initialized at 0x5623292ff9c0 Jul 25 12:13:49.087643 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: python threads support enabled Jul 25 12:13:49.087643 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: your server socket listen backlog is limited to 100 connections Jul 25 12:13:49.087643 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: your mercy for graceful operations on workers is 90 seconds Jul 25 12:13:49.088185 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 12:13:49.088185 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: *** Operational MODE: preforking *** Jul 25 12:13:49.088533 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: *** uWSGI is running in multiple interpreter mode *** Jul 25 12:13:49.088533 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: spawned uWSGI master process (pid: 117765) Jul 25 12:13:49.088732 dv-cinder-797608-61-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 12:13:49.089260 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: spawned uWSGI worker 1 (pid: 117776, cores: 1) Jul 25 12:13:49.089772 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: spawned uWSGI worker 2 (pid: 117777, cores: 1) Jul 25 12:13:49.090071 dv-cinder-797608-61-iscsi devstack@n-api.service[117765]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 12:13:49.764775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 12:13:49.771560 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 12:13:50.925653 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:13:50.925653 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: from cryptography.utils import int_from_bytes Jul 25 12:13:50.926290 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:13:50.926290 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: from cryptography.utils import int_from_bytes Jul 25 12:13:50.929299 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:13:50.929299 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: from cryptography.utils import int_from_bytes Jul 25 12:13:50.929736 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:13:50.929736 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: from cryptography.utils import int_from_bytes Jul 25 12:13:53.351574 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:13:53.352253 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:13:53.352534 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:13:53.352728 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:13:53.352995 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:13:53.353386 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.353713 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.354038 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.354360 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.354693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.355008 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.355371 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.355720 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.356053 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.356318 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.356640 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.356979 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-61-iscsi {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.357299 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.357764 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.358085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.358410 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.358720 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.359047 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.359356 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.359885 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.361271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.361271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.361271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.361607 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.361871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.362184 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.362489 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:13:53.362867 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.362954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:13:53.363040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.363120 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.363355 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:13:53.363480 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.363692 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:13:53.363921 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-61-iscsi {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.364155 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:13:53.364369 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.364618 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.364840 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.365068 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.365298 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.365507 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.365728 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.365946 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.366170 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.366378 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.366586 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.366805 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.367024 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.367261 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.367506 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.367767 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.367948 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.368157 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.368157 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.368499 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.368658 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.368831 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.368977 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-61-iscsi {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.369122 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.369309 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.369464 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.369464 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.369747 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.369899 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.370060 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.370213 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.370371 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.370550 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.370705 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.371340 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.371497 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.371681 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.371846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.372000 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.372000 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.372297 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.372297 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.372615 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.373267 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.373425 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.373572 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.373724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.373724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.374017 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.374464 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.374619 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.374774 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.374945 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.375105 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.375259 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.375414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.375595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.375760 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.375912 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.376072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.376226 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.376379 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.376533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-61-iscsi {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.376687 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.376849 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.377029 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.377842 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.378005 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.378154 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.378307 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.378307 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.378601 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.378601 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.378882 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.379034 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.379194 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.379350 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.379515 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.379714 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.379871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.380026 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.380185 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.380336 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.380481 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.380633 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.380777 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.380928 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.381088 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.381241 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.381393 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.381548 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.381702 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.381855 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.382009 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.382154 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.382299 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.382442 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.382591 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.382749 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.383001 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.383435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.383641 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.383789 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.383988 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.384149 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.384583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.384751 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.384926 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.387841 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.388022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.388189 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.389389 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.389560 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.389717 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.389868 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.390045 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.390205 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.390352 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.390497 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.390650 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.390806 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.390978 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.391134 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.391279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.391432 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.393083 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.393289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.393486 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.393646 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.393794 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.393949 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.394104 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.394261 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.394447 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.394621 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.394784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.394940 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.395095 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.395250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.395396 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.395586 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.395749 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.395908 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.396061 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.396222 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.396368 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.396513 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.396665 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.396824 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.396979 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.397133 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.397287 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.397452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.399979 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.400168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.400337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.400510 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.400674 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.400835 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.401071 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.401230 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.401384 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.401531 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.401675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.401830 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.401989 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.402178 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.402337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.402491 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.402663 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.402830 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.402977 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.403130 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.403277 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.403432 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.403650 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.403816 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.403962 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.404118 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.404271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.404426 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.404571 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.404732 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.404889 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.405034 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.405178 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.406890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.407067 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.407228 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.407375 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.407528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.407742 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.407942 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.408130 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.408278 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.408423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.408576 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.408727 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.408872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.409033 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.409180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.409324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.409475 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.409629 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.409795 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.409949 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.410094 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.410238 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.410382 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.412646 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.412821 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.412989 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.413147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.413294 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.413447 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.413592 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.413760 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.413915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.414062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.414062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.414357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.414505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.414656 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.414821 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.414974 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.415133 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.415286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.415441 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.415610 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.415772 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.415920 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.416103 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.416261 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.416415 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.416561 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.420320 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.420506 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.420716 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.420915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.421085 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.421241 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.421409 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.421566 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.421722 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.421878 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.422033 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.422033 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.422320 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.422475 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.422629 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.422782 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.422936 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.423091 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.423244 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.423417 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.423642 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.423795 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.423953 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.424099 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.424253 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.424409 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.424565 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.424717 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.424864 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.425017 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.425176 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.425324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.425324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.425619 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.425771 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.425923 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.426078 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:13:53.426242 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.426399 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.426552 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.426552 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.426867 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.427030 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.427185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.427331 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.427487 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.427681 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.427837 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.427992 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.428148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.428294 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.428447 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.428593 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.428745 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.428890 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.429050 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.429197 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.429353 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.429499 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.429652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.429811 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.429965 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.430117 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.433870 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.434063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.434230 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.434400 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.434552 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.434708 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.434862 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.435028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.435190 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.435354 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.435502 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.435753 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.435901 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.436045 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.436189 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.436346 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.436492 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.436645 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.436791 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.436938 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.437104 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.437258 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.437413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.437559 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.437704 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.437849 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.438085 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.438241 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.438409 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.438563 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.438710 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.438855 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.440872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.441075 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.441275 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.441436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.441586 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.441732 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.441889 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.442045 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.442192 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.442337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.442490 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.442649 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.442803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.442974 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.443129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.443284 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.443437 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.443618 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.443783 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.443938 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.444085 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.444231 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.444376 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.444533 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.444687 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.444840 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.445005 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.445166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.445324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.447342 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.447518 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.447699 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.447850 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.448009 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.448159 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.448319 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.448469 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.448621 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.448774 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.448932 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.449639 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.449799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.449947 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.450101 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.451703 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.451876 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.452057 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.452218 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.452367 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.452513 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.452750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.452927 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.453092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.453239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.453392 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.453547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.453701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.453857 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.454014 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.454161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.454313 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.454466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.454983 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.455174 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.455345 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.455501 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.456184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.456342 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.456497 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.456659 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.457070 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.457233 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.457380 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.457533 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.457679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.457843 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.458054 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.458222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.458369 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.458514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.458668 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.458829 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.458986 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.459177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.459330 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.459483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.459672 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.460015 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.460206 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.460335 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.460455 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.460569 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.460696 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.461221 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.461376 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.461524 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.461669 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.461815 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.461975 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.462123 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.462317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.462482 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.462646 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.462811 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.462975 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.463129 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.463281 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.463433 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.463615 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.463787 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.463947 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.464109 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.464262 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.464460 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.464653 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.464838 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.465035 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.465222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.465387 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.465539 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.465690 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.466104 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.467102 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.467314 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.467638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.468048 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.468222 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.468424 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.468670 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.468830 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.468982 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.469148 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.469316 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.469502 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.469702 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.469887 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.470040 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.470199 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.470366 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.470520 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.470678 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.470842 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.471155 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.471680 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.471890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.472054 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.472208 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.472368 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.472529 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.472780 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.472949 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.473103 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.473255 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.473406 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.473648 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.473865 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.473984 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.474104 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.477709 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.477881 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.478083 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.478254 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.478420 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.478576 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.478728 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.479358 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.479579 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.479744 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.479899 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.480089 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.480781 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.480951 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.481304 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.481933 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.482099 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.482295 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.482449 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.482694 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.482849 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.483010 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.483172 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.483357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.483518 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.483708 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.483863 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.484024 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.484176 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.484360 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.484520 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.484686 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.484858 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.485011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.485182 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.485454 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.485623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.485784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.485957 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.487136 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.487318 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.487525 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.487741 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.487985 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.488171 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.488696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.488860 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.489013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.489175 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.489338 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.489524 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.489681 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.489843 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.489995 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.490161 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.490324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.490477 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.490637 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.490802 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.490954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.491115 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.491287 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.491599 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.491829 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.491986 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.492151 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.492151 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.492487 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.492652 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.492804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.492956 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.493129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.493291 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.493445 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.493630 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.493793 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.493945 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.494109 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.494269 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.494422 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.494583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.494742 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.494900 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.495076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.495229 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.495380 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.495533 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.495737 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.497122 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.497302 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.497466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.497667 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.497834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.498013 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.498266 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.498473 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.498473 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.498473 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.498473 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.498473 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.498473 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.499255 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.499376 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.499664 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.499822 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.499986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.500149 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.500309 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.500461 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.500624 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.500820 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.500983 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.501144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.501303 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.501454 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.501786 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.502072 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.502242 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.502403 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.502555 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.502706 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.502706 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.503006 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.503174 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.503335 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.503488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.503488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.503820 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.503982 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.504143 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.504302 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.504453 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.504612 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.504764 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.504975 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.504975 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.505374 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.505534 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.505685 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.505864 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.506032 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.506186 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.506351 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.506513 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.506895 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.507056 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.507215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.507389 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.507561 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.507561 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.507877 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.508036 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.508197 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.508464 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.508624 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.508624 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.508938 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.509092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.509264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.509511 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.509680 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.509847 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.510001 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.510153 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.510305 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.510456 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.510615 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.510848 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.511003 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.511154 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.511306 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.511306 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.511690 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.511986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.512226 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.512385 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.512536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.512536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.512536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.512536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.513130 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.513284 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.513444 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.514015 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.514189 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.514357 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.514520 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.514691 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.514691 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.514691 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.514691 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.514691 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.515429 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.515619 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.515791 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.515954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.515954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.516243 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.516407 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.516569 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.516747 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.517099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.517268 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.517429 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.517589 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.517752 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.517911 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.517911 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.517911 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.517911 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.518514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.518777 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.518943 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.519097 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.519249 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.519400 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.519400 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.519754 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.519908 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.520166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.520334 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.520495 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.520667 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.520834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.520994 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.521154 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.521307 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.521473 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.521627 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.521787 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.521960 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.522251 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.522485 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.522658 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.522813 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.522965 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.523127 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.523280 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.523439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.523633 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.523800 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.523962 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.524114 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.524272 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.524425 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.524590 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.524750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.524750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.525039 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.525201 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.525366 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.525526 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.525678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.525847 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.526003 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.526169 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.526927 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.527340 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.527499 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.527716 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.527885 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.528040 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.528192 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.528352 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.528515 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.528723 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.529257 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.529421 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.529421 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.529421 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.529875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.530037 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.530215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.530489 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.530655 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.530808 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.530975 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.531137 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.531298 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.531451 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.531623 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.531781 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.531781 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.532098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.532390 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.532657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.532836 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.533007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.533204 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.533366 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.533519 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.533670 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.533822 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.533983 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.534143 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.534302 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.534456 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.534614 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.534782 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.534949 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.535102 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.535255 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.535409 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.535662 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.535829 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.536246 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.536412 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.536573 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.536726 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.536879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.537039 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.537516 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.537687 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.537840 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.538106 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.538278 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.538449 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.538604 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.538757 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.538909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.539086 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.539562 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.539752 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.539909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.540073 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.540540 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.540714 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.540876 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.541044 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.541044 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.541342 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.541502 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.541678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.541848 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.542005 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.542157 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.542308 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.542590 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.543373 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.543585 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.543585 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.543798 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.543904 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.544000 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.544090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.544184 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.544277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.544363 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.544447 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.544530 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.544614 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.544710 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.544804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.544897 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.544981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.545064 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.545147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.545239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.545331 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.545424 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.545516 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.545608 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.545707 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.545800 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.545893 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.545985 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.546080 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.546166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.546261 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.546261 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.546422 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.546515 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.546600 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.546683 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.546828 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.546963 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.546963 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.546963 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.547356 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.547701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.547805 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.547892 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.547984 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.548077 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.548163 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.548260 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.548353 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.548439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.548523 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.548614 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.548614 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.548781 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.548868 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.549010 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.549100 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.549184 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.549275 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.549395 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.549501 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.549597 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.549689 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.549781 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.549866 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.549866 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.550030 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.550113 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.550196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.550279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.550371 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.550465 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.550557 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.550649 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.550734 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.550825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.550918 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.551010 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.551096 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.551179 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.551262 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.551352 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.551352 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.551517 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.551644 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.551644 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.551809 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.551901 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.551998 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.552084 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.552167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.552250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.552334 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.552429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.552522 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.552626 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.552711 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.552794 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.552866 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.552945 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.553020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.553099 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.553171 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.553265 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.553357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.553455 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.553541 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.553632 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.553716 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.553800 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.553800 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.553963 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.554048 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.554131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.554221 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.554312 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.554411 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.554503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.554588 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.554677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.554769 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.554860 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.554953 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.555046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.555137 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.555222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.555306 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.555306 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.555306 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.555631 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.555733 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.555820 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.555914 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.556008 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.556107 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.556203 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.556289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.556383 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.556477 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.556571 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.556664 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.556756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.556842 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.556932 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.557069 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.557172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.557260 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.557344 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.557437 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.557536 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.557776 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.557882 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.557977 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.558064 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.558156 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.558251 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.558357 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.559045 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.559141 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.559141 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.559297 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.559390 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.559483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.559594 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.559694 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.559826 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.559927 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.560028 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.560115 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.560205 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.560291 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.560375 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.560472 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.560565 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.560657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.560743 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.560743 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.560901 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.560999 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.561093 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.561228 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.561322 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.561407 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.561407 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.561574 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.561668 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.561753 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.561836 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.561918 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.562007 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.562147 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.562242 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.562333 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.562425 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.562509 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.562601 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.562693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.562779 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.562903 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.562995 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.563086 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.563181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.563268 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.563351 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.563441 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.563647 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.563743 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.563841 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.563928 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.563928 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.564081 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.564164 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.564252 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.564348 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.564435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.564525 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.564609 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.564694 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.564786 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.564879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.564971 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565056 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565056 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565056 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565307 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565400 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565492 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565578 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.565682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.566332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.566332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.566332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.566332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.566332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.566332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.566332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.566332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.566934 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.567024 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.567110 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.567110 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.567310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.567392 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.567465 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.567536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.567628 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.567718 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.567993 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.568085 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.568383 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.568460 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.568599 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.568695 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.568769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.568839 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.568839 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.568972 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.569058 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.569132 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.569209 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.569282 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.569352 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.569421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.569531 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.569615 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.569688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.569765 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.569838 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.569915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.569997 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.570070 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.570070 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.570213 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.570286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.570356 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.570434 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.570513 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.570591 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.570664 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.570664 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.570804 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.570907 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.571004 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.571094 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.571169 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.571247 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.571327 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.571409 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.571481 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.571652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.571740 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.571821 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.571906 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.571980 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.572051 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.572051 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.572206 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.572288 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.572373 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.572454 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.572527 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.572607 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.572687 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.572687 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.572835 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.572914 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.572995 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.573069 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.573147 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.573233 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.573315 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.573389 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.573460 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.573583 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.573664 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.573780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.573864 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.573937 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.574040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.574146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.574220 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.574305 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.574444 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.574550 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.574634 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.574706 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.574815 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.574902 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.574976 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.575053 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.575133 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.575206 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.575290 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.575363 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.575436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.575529 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.575623 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.575711 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.575711 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.575892 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.575972 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.576044 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.576114 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.576198 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.576277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.576377 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.576453 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.576535 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.576622 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.576706 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.576780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.576858 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.576938 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.577011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.577083 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.577167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.577249 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.577322 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.577393 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.577464 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.577618 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.577701 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.577774 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.577845 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.578236 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.578336 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.578475 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.578612 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.578703 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.578788 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.578907 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.579005 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.579005 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.579174 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.579318 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.579436 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.579436 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.579752 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.579858 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.579952 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.580067 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.580204 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.580327 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.580473 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.580652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.580742 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.580825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.580988 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.581120 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.581281 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.581385 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.581468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.581542 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.581620 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.581620 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.581620 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.581620 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.581927 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.582055 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.582168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.582257 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.582338 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.582338 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.582603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.582741 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.582964 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.583076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.583155 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.583235 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.583308 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.583308 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.583448 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.583534 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.583663 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.583663 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.583663 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.583663 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.583663 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.583663 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.584165 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.584254 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.584254 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.584254 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.584254 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.584600 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.584709 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.584709 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.584873 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.584955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.585069 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.585162 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.585321 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.585411 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.585496 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.585589 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.585725 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.585818 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.585900 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.585991 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.586075 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.586171 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.586261 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.586344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.586434 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.586525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.586525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.586688 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.586773 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.586863 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.586948 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.586948 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.587122 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.587207 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.587298 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.587396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.587494 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.587640 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.587640 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.587813 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.587897 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.587987 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.588151 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.588151 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.588482 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.588578 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.588664 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.588753 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.588847 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.588932 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.589025 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.589118 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.589118 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.589550 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.589675 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.589675 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.589675 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.590004 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.590125 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.590245 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.590357 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.590464 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.590557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.590643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.590726 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.590810 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.590900 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.590993 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.591087 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.591173 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.591173 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.591332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.591417 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.591508 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.591686 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.591787 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.591874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.591958 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.592050 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.592135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.592135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.592286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.592368 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.592440 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.592520 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.592605 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.592687 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.592777 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.592861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.592944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.593041 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.593126 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.593204 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.593281 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.593354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.593430 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.593514 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.593599 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.593682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.593765 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.593848 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.593943 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.594029 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.594112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.594194 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.594277 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.594367 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.594461 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.594552 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.594637 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.594719 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.594809 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.594893 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.594989 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.595088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.595174 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.595257 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.595333 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.595413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.595498 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.595703 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.595806 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.595894 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.595977 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.596070 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.596162 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.596251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.596341 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.596426 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.596509 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.596605 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.596692 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.596776 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.596865 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.596956 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.597042 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.597135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.597217 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.597300 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.597687 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.597787 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.598003 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.598096 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.598381 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.598527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.598643 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.598736 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.598957 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.599051 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.599284 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.599377 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.599632 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.599730 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.599951 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.600053 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.600276 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.600376 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.600589 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.600692 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.600901 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.600993 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.601220 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.601313 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.601538 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.601640 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.601856 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.601955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.602173 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.602266 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.602486 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.602702 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.602795 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.602887 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.603095 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.603189 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.603408 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.603501 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.603745 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.603851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.604055 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.604154 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.604364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.604464 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.604677 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.604777 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.604986 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.605079 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.605819 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.605922 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.606131 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.606230 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.606440 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.606533 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.606753 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.606854 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.607060 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.607152 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.607368 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.607471 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.607701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.607808 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.608013 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.608113 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.608322 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.608444 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.608632 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.608736 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.608942 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.609042 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.609248 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.609350 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.609559 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.609675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.609865 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.609994 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.610174 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.610320 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.610481 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.610653 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.610820 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.610969 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.611158 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.611298 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.611477 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.611654 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.611830 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.611975 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.612146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.612302 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.612474 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.612618 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.612788 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.612954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.613121 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.613296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.613434 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.613632 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.613754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.613963 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.614057 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.614275 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.614419 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.614584 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.614678 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.614896 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.614996 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.615210 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.615526 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.615691 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.615780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.615874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.616018 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.616162 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.616263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.616470 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.616572 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.616787 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.616880 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.617100 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.617194 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.617413 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.617519 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.617725 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.617818 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.618036 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.618129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.618350 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.618455 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.618695 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.618799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.618962 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.619063 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.619275 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.619382 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.619607 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.619719 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.619920 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.620014 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.620231 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.620330 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.620541 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.620633 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.621472 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.621734 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.621876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.622070 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.622171 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.622386 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.622480 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.622700 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.622841 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.623010 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.623111 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.623350 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.623444 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.623693 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.623799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.624027 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.624128 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.624354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.624484 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.624671 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.624763 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.625001 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.625102 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.625318 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.625414 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.625649 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.625750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.625970 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.626110 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.626287 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.626381 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.626599 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.626700 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.626848 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:13:53.626941 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.627237 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.627561 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.627891 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.628206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.628520 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.628838 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.629167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.629530 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.629844 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.630175 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.630495 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.630821 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.631143 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.631463 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.631825 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.632140 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.632454 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.632768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.633081 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.633395 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.633714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.634027 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.634339 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.634659 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.634979 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.635308 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.635663 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.635981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.636313 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.636673 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.637025 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.637343 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.637692 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.638026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.638345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.638662 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.638976 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:13:53.639223 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:13:53.689292 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO dbcounter [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] Registered counter for database nova_api Jul 25 12:13:53.702010 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO dbcounter [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] Registered counter for database nova_api Jul 25 12:13:53.709630 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_db.sqlalchemy.engines [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:13:53.716528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writer thread running {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:13:53.722576 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_db.sqlalchemy.engines [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:13:53.729217 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writer thread running {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:13:53.771980 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.context [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bd86971f-66ee-4017-8a4d-2ac53750a8a3(cell1) {{(pid=117776) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 12:13:53.776201 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:13:53.777823 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:13:53.778647 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:13:53.780671 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:13:53.782694 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO dbcounter [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] Registered counter for database nova_cell0 Jul 25 12:13:53.785110 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.context [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bd86971f-66ee-4017-8a4d-2ac53750a8a3(cell1) {{(pid=117777) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 12:13:53.787000 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO dbcounter [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] Registered counter for database nova_cell1 Jul 25 12:13:53.789631 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:13:53.791323 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:13:53.792056 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:13:53.794650 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:13:53.796652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_db.sqlalchemy.engines [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:13:53.796799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO dbcounter [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] Registered counter for database nova_cell0 Jul 25 12:13:53.797528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_db.sqlalchemy.engines [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:13:53.800949 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO dbcounter [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] Registered counter for database nova_cell1 Jul 25 12:13:53.805519 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writer thread running {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:13:53.805856 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writer thread running {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:13:53.809600 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_db.sqlalchemy.engines [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:13:53.811010 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_db.sqlalchemy.engines [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:13:53.815707 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writer thread running {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:13:53.953487 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO dbcounter [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] Registered counter for database nova_cell0 Jul 25 12:13:53.955778 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writer thread running {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:13:53.960073 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_db.sqlalchemy.engines [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:13:53.965107 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writer thread running {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:13:53.966733 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO dbcounter [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] Registered counter for database nova_cell0 Jul 25 12:13:53.975136 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_db.sqlalchemy.engines [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:13:53.979470 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writer thread running {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:13:54.297333 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: WARNING keystonemiddleware.auth_token [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:13:54.304875 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: WARNING keystonemiddleware.auth_token [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:13:54.309339 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: WARNING keystonemiddleware.auth_token [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:13:54.316787 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: WARNING keystonemiddleware.auth_token [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:13:54.653785 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: WARNING keystonemiddleware.auth_token [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:13:54.660049 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: WARNING keystonemiddleware.auth_token [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:13:54.660532 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: WARNING keystonemiddleware.auth_token [None req-3bac6663-55b8-469c-9814-035ac4e62585 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:13:54.666536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5623292ff9c0 pid: 117776 (default app) Jul 25 12:13:54.666707 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: WARNING keystonemiddleware.auth_token [None req-70bc482c-b6a3-4a64-b476-f6cffbf5654a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:13:54.672188 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5623292ff9c0 pid: 117777 (default app) Jul 25 12:14:34.352379 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:34.354188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:34.354858 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:34.355771 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:35.563265 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f3e304af-ba4a-4f4a-9bb6-e496442b2da6 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Action: 'create', calling method: .version_select at 0x7f942e4104c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1013635857"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:14:36.155480 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:36.157300 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:36.159752 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:36.161097 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:37.406751 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-025b7d32-69cf-4ad6-8d9c-353c5bc050e2 tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] Action: 'create', calling method: .version_select at 0x7f942e40f4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1367473021", "metadata": {"Type": "work"}}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:14:37.735955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f3e304af-ba4a-4f4a-9bb6-e496442b2da6 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.392067 Jul 25 12:14:37.747118 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Mon Jul 25 12:14:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3404 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 12:14:37.752740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3568289e-cc04-4309-8298-937503868407 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e2623a0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:37.861695 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3568289e-cc04-4309-8298-937503868407 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321" status: 200 len: 345 microversion: 2.1 time: 0.113632 Jul 25 12:14:37.862599 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 2/2] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:14:37 2022] GET /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321 => generated 345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:38.875484 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f2ea1f97-0d58-48cf-9832-c5e1b2483c3b tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e262a60>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:38.935176 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-025b7d32-69cf-4ad6-8d9c-353c5bc050e2 tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.784952 Jul 25 12:14:38.936453 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Jul 25 12:14:36 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2788 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 25 12:14:38.953861 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-feb7ff4e-fc2b-4fd6-9bd0-fc9ac35af695 tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] Calling method '.version_select at 0x7f942e2613a0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:38.999399 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f2ea1f97-0d58-48cf-9832-c5e1b2483c3b tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321" status: 200 len: 346 microversion: 2.1 time: 0.127667 Jul 25 12:14:39.000027 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 3/4] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:14:38 2022] GET /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321 => generated 346 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:39.012622 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8b908a09-8126-4dd0-af1c-10dc586b498c tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Action: 'create', calling method: .version_select at 0x7f942e27b0d0>, body: {"snapshot": {"volume_id": "9a4771ba-64bc-4e36-8511-7c09a314e321", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1321691455"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:14:39.113665 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-feb7ff4e-fc2b-4fd6-9bd0-fc9ac35af695 tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026" status: 200 len: 353 microversion: 2.1 time: 0.166372 Jul 25 12:14:39.115259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 2/5] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:14:38 2022] GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026 => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:14:39.604615 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8b908a09-8126-4dd0-af1c-10dc586b498c tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.595923 Jul 25 12:14:39.605195 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 4/6] 10.222.0.42 () {60 vars in 1162 bytes} [Mon Jul 25 12:14:39 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:39.616478 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-84dd91e6-18f4-498d-bd27-fd3bc102d035 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e261a60>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:39.823603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-84dd91e6-18f4-498d-bd27-fd3bc102d035 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef" status: 200 len: 287 microversion: 2.1 time: 0.210905 Jul 25 12:14:39.830380 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 3/7] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Jul 25 12:14:39 2022] GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef => generated 287 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:39.835306 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a0f69ef4-c3f5-43eb-ae41-adcaac762c14 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e262dc0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:39.910979 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a0f69ef4-c3f5-43eb-ae41-adcaac762c14 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.079112 Jul 25 12:14:39.912279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 5/8] 10.222.0.42 () {58 vars in 1140 bytes} [Mon Jul 25 12:14:39 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:39.927420 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a3881f2c-17ca-452a-aada-e5705b8c65e6 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e2791f0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:39.967468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a3881f2c-17ca-452a-aada-e5705b8c65e6 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef" status: 200 len: 287 microversion: 2.1 time: 0.046769 Jul 25 12:14:39.973467 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 4/9] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Jul 25 12:14:39 2022] GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:40.128989 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ba9cab39-5ee0-490f-abbb-01c9a4d1034e tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] Calling method '.version_select at 0x7f942e27bb80>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:40.230418 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ba9cab39-5ee0-490f-abbb-01c9a4d1034e tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026" status: 200 len: 354 microversion: 2.1 time: 0.105686 Jul 25 12:14:40.231769 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 6/10] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:14:40 2022] GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026 => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:40.247255 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c3e013e5-854d-468c-b433-a2fdbb6270a5 tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] Calling method '.version_select at 0x7f942e261b80>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:40.338290 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c3e013e5-854d-468c-b433-a2fdbb6270a5 tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026" status: 200 len: 354 microversion: 2.1 time: 0.097119 Jul 25 12:14:40.358658 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 5/11] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:14:40 2022] GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026 => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:40.359655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0455ef81-977b-4f0a-a9f1-4d7e62ec509d tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] Calling method '.version_select at 0x7f942e27b1f0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:40.482188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0455ef81-977b-4f0a-a9f1-4d7e62ec509d tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026" status: 202 len: 0 microversion: 2.1 time: 0.127277 Jul 25 12:14:40.486893 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 7/12] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Jul 25 12:14:40 2022] DELETE /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:14:40.492654 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e9067215-a710-4669-b8e7-4da4bef86c47 tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] Calling method '.version_select at 0x7f942e2614c0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:40.587105 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e9067215-a710-4669-b8e7-4da4bef86c47 tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026" status: 200 len: 353 microversion: 2.1 time: 0.098097 Jul 25 12:14:40.588096 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 6/13] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:14:40 2022] GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:40.981066 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-15a1767f-341d-43a8-9a00-36dc8b9a3d2b tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e2623a0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:41.034516 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-15a1767f-341d-43a8-9a00-36dc8b9a3d2b tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef" status: 200 len: 287 microversion: 2.1 time: 0.057981 Jul 25 12:14:41.035090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 8/14] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Jul 25 12:14:40 2022] GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:41.604159 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-006311fc-7b97-45a0-9456-6b89630f388d tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] Calling method '.version_select at 0x7f942e279430>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:41.688197 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-006311fc-7b97-45a0-9456-6b89630f388d tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026" status: 200 len: 353 microversion: 2.1 time: 0.090364 Jul 25 12:14:41.688772 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 7/15] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:14:41 2022] GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:42.055483 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-48745526-9f24-445e-985d-6457645976dd tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e262b80>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:42.111996 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-48745526-9f24-445e-985d-6457645976dd tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef" status: 200 len: 287 microversion: 2.1 time: 0.067115 Jul 25 12:14:42.113676 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 9/16] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Jul 25 12:14:42 2022] GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:42.701020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-08bd992b-a5e5-4d10-89ed-3f459ed93f47 tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] Calling method '.version_select at 0x7f942e261430>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:42.771848 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-08bd992b-a5e5-4d10-89ed-3f459ed93f47 tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026" status: 200 len: 353 microversion: 2.1 time: 0.074529 Jul 25 12:14:42.772545 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 8/17] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:14:42 2022] GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026 => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:43.125853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-15fe2457-d731-482e-b63f-d616ba76ca17 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e27b430>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:43.180723 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-15fe2457-d731-482e-b63f-d616ba76ca17 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef" status: 200 len: 288 microversion: 2.1 time: 0.059091 Jul 25 12:14:43.190121 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 10/18] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Jul 25 12:14:43 2022] GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef => generated 288 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:43.193729 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f8bf0b30-3dee-4a2a-a58c-37c01c367d46 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e261af0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:43.303337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f8bf0b30-3dee-4a2a-a58c-37c01c367d46 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef" status: 202 len: 0 microversion: 2.1 time: 0.113290 Jul 25 12:14:43.304086 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 9/19] 10.222.0.42 () {58 vars in 1254 bytes} [Mon Jul 25 12:14:43 2022] DELETE /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:14:43.312994 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f9522e74-3a37-4a3b-bbc7-df7281608b94 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e262ca0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:43.359320 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f9522e74-3a37-4a3b-bbc7-df7281608b94 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef" status: 200 len: 287 microversion: 2.1 time: 0.049945 Jul 25 12:14:43.360495 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 11/20] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Jul 25 12:14:43 2022] GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:43.788187 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1903cac8-dbd4-4a0d-aaec-0406ea620a0f tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] Calling method '.version_select at 0x7f942e279790>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:43.858175 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-1903cac8-dbd4-4a0d-aaec-0406ea620a0f tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] HTTP exception thrown: Volume af6bb4a8-f33b-4ace-8079-ef408ca84026 could not be found. Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1903cac8-dbd4-4a0d-aaec-0406ea620a0f tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] Request method failure captured: Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026 HTTP/1.1 Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3oksAnGbeQVMeXpuXPeZyk0lqgY9oI-5u69VL9awyHor1Ch6C8818PsBng0Bnv4pqSWG5eXgebwLRV1bpE_TIUbIrhx76b1CHde7SdjuqKHfIkuLgAwiJ6kwlYynz71Ty7fBF4LyU9frXpZdV4sByHUT8ky82MifX18JsmJcSK8qgpA Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: e7e349c1736b41e5ac722809adbf3c69 Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesGetTestJSON-662778122 Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:14:43.863909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:14:43.865012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e7e349c1736b41e5ac722809adbf3c69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e7e349c1736b41e5ac722809adbf3c69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e7e349c1736b41e5ac722809adbf3c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e7e349c1736b41e5ac722809adbf3c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:14:43.865012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesGetTestJSON-662778122 Jul 25 12:14:43.865012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: e7e349c1736b41e5ac722809adbf3c69 Jul 25 12:14:43.865012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesGetTestJSON-662778122 Jul 25 12:14:43.865012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesGetTestJSON-662778122-project Jul 25 12:14:43.865012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:14:43.865012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:14:43.865012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 196c9e67f28046ee98a08a39d0f1e4ba Jul 25 12:14:43.865012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesGetTestJSON-662778122-project Jul 25 12:14:43.865012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: Jul 25 12:14:43.865012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Volume af6bb4a8-f33b-4ace-8079-ef408ca84026 could not be found. Jul 25 12:14:43.865012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': 'af6bb4a8-f33b-4ace-8079-ef408ca84026'} Jul 25 12:14:43.865012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af6bb4a8-f33b-4ace-8079-ef408ca84026 could not be found. (HTTP 404) (Request-ID: req-6902ea82-a1ec-4cd3-88d5-c991fde66c76) Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:43.865812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:14:43.866770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af6bb4a8-f33b-4ace-8079-ef408ca84026 could not be found. Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 12:14:43.867678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:14:43.868583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume af6bb4a8-f33b-4ace-8079-ef408ca84026 could not be found. Jul 25 12:14:43.868583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:43.868583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:43.868583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:43.868583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:43.868583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:14:43.868583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:14:43.868583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:14:43.868583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:14:43.868583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af6bb4a8-f33b-4ace-8079-ef408ca84026 could not be found. Jul 25 12:14:43.868583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:43.875727 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1903cac8-dbd4-4a0d-aaec-0406ea620a0f tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] Returning 404 to user: Volume af6bb4a8-f33b-4ace-8079-ef408ca84026 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:14:43.876928 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1903cac8-dbd4-4a0d-aaec-0406ea620a0f tempest-VolumesGetTestJSON-662778122 tempest-VolumesGetTestJSON-662778122-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026" status: 404 len: 109 microversion: 2.1 time: 0.094234 Jul 25 12:14:43.882378 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 10/21] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:14:43 2022] GET /compute/v2.1/os-volumes/af6bb4a8-f33b-4ace-8079-ef408ca84026 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:14:44.373296 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b007a527-3ec1-4337-9e4d-1d7f826cd954 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e2624c0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:44.443078 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-b007a527-3ec1-4337-9e4d-1d7f826cd954 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] HTTP exception thrown: Snapshot 793a25f5-2f85-41b5-8737-1b760dea74ef could not be found. Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b007a527-3ec1-4337-9e4d-1d7f826cd954 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Request method failure captured: Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef HTTP/1.1 Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3okqYmxjt6oA7pLagPfvVfxDKNG7B_fKDSsjidJuT451QZH_XW2SmXHgwHQMn0Jr4xbnBA8g0wGBTDai_IrVVhI3vbcOg2Ar5-axWoSZdDYxNjFa35IYA9VQQCLxn567fb81OHTT2JdXKM4JcnxxHfJ4jsgNQd9xrHjtHUqFyWH9h_o Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 6ceed8120f864c4aa210ae72a2b1e9c5 Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-888425215 Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:14:44.449146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:14:44.450344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:14:44.450344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesSnapshotsTestJSON-888425215 Jul 25 12:14:44.450344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 6ceed8120f864c4aa210ae72a2b1e9c5 Jul 25 12:14:44.450344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-888425215 Jul 25 12:14:44.450344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesSnapshotsTestJSON-888425215-project Jul 25 12:14:44.450344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:14:44.450344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:14:44.450344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: b7c740c7ce2e4b3c984247b6b2b69da1 Jul 25 12:14:44.450344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesSnapshotsTestJSON-888425215-project Jul 25 12:14:44.450344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: Jul 25 12:14:44.450344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Snapshot 793a25f5-2f85-41b5-8737-1b760dea74ef could not be found. Jul 25 12:14:44.450344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': '793a25f5-2f85-41b5-8737-1b760dea74ef'} Jul 25 12:14:44.450344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 793a25f5-2f85-41b5-8737-1b760dea74ef could not be found. (HTTP 404) (Request-ID: req-149c9a1e-8e32-443f-a2bf-53d39f010279) Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:44.451148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:14:44.452464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 793a25f5-2f85-41b5-8737-1b760dea74ef could not be found. Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 12:14:44.453525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:14:44.454638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 793a25f5-2f85-41b5-8737-1b760dea74ef could not be found. Jul 25 12:14:44.454638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:44.454638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:44.454638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:44.454638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:44.454638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:14:44.454638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:14:44.454638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:14:44.454638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:14:44.454638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 793a25f5-2f85-41b5-8737-1b760dea74ef could not be found. Jul 25 12:14:44.454638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:44.456233 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b007a527-3ec1-4337-9e4d-1d7f826cd954 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Returning 404 to user: Snapshot 793a25f5-2f85-41b5-8737-1b760dea74ef could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:14:44.460660 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b007a527-3ec1-4337-9e4d-1d7f826cd954 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef" status: 404 len: 111 microversion: 2.1 time: 0.087658 Jul 25 12:14:44.461521 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 12/22] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Jul 25 12:14:44 2022] GET /compute/v2.1/os-snapshots/793a25f5-2f85-41b5-8737-1b760dea74ef => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:14:44.478160 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bd509ab3-3333-45e8-853d-120cf54ae68c tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e279b80>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:44.641199 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bd509ab3-3333-45e8-853d-120cf54ae68c tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321" status: 202 len: 0 microversion: 2.1 time: 0.174543 Jul 25 12:14:44.643258 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Jul 25 12:14:44 2022] DELETE /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:14:44.670670 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ab50f171-1dd2-4d66-86f2-7191fe2b7c4f tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e27b0d0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:44.826064 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ab50f171-1dd2-4d66-86f2-7191fe2b7c4f tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321" status: 200 len: 345 microversion: 2.1 time: 0.179365 Jul 25 12:14:44.827222 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 13/24] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:14:44 2022] GET /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321 => generated 345 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:45.580282 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-925931db-9e6b-4753-93ed-f3cdfcf5c438 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Action: 'create', calling method: .version_select at 0x7f942e1e6280>, body: {"keypair": {"name": "tempest-keypair-560487720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEGBRB/ElfFURQpDAyJHMLA5mfWgC364T/m3l2EcM3HvGO79dzMuNVOSDtfVLJzLwqOBKkvX+SeAC+X6zA9u+xJfxmG+vEqwUdZaJO4G3ATLiky7ssBO8YWvxEs5637GQ=="}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:14:45.700735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-925931db-9e6b-4753-93ed-f3cdfcf5c438 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Getting quotas for project aef3a5bd8ffa43718ea02647f1f74fc8. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:14:45.741423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-925931db-9e6b-4753-93ed-f3cdfcf5c438 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Getting quotas for user d2d6f10a6fe841e5b1d12bce78f97d91 and project aef3a5bd8ffa43718ea02647f1f74fc8. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:14:45.842573 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-37bb7f30-6cf7-46de-ad7f-eacdd742e1ee tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e1e34c0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:45.933305 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-37bb7f30-6cf7-46de-ad7f-eacdd742e1ee tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] HTTP exception thrown: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-37bb7f30-6cf7-46de-ad7f-eacdd742e1ee tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Request method failure captured: Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321 HTTP/1.1 Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3okqYmxjt6oA7pLagPfvVfxDKNG7B_fKDSsjidJuT451QZH_XW2SmXHgwHQMn0Jr4xbnBA8g0wGBTDai_IrVVhI3vbcOg2Ar5-axWoSZdDYxNjFa35IYA9VQQCLxn567fb81OHTT2JdXKM4JcnxxHfJ4jsgNQd9xrHjtHUqFyWH9h_o Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 6ceed8120f864c4aa210ae72a2b1e9c5 Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-888425215 Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:14:45.937168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:14:45.938435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:14:45.938435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesSnapshotsTestJSON-888425215 Jul 25 12:14:45.938435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 6ceed8120f864c4aa210ae72a2b1e9c5 Jul 25 12:14:45.938435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-888425215 Jul 25 12:14:45.938435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesSnapshotsTestJSON-888425215-project Jul 25 12:14:45.938435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:14:45.938435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:14:45.938435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: b7c740c7ce2e4b3c984247b6b2b69da1 Jul 25 12:14:45.938435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesSnapshotsTestJSON-888425215-project Jul 25 12:14:45.938435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: Jul 25 12:14:45.938435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:45.938435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': '9a4771ba-64bc-4e36-8511-7c09a314e321'} Jul 25 12:14:45.938435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. (HTTP 404) (Request-ID: req-a69299a2-639b-4a78-b362-2b9ead1f4fb0) Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:45.939119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:14:45.940263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 12:14:45.941981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:14:45.943872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:45.943872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:45.943872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:45.943872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:45.943872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:45.943872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:14:45.943872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:14:45.943872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:14:45.943872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:14:45.943872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:45.943872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:45.943872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-37bb7f30-6cf7-46de-ad7f-eacdd742e1ee tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Returning 404 to user: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:14:45.943872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-37bb7f30-6cf7-46de-ad7f-eacdd742e1ee tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321" status: 404 len: 109 microversion: 2.1 time: 0.106084 Jul 25 12:14:45.952957 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-925931db-9e6b-4753-93ed-f3cdfcf5c438 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.655715 Jul 25 12:14:45.952957 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 12/25] 10.222.0.42 () {62 vars in 1200 bytes} [Mon Jul 25 12:14:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 657 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 12:14:45.955487 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 14/26] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:14:45 2022] GET /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:14:45.960697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bd9d9110-66ba-4843-9286-f21b6b9112c8 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942d95c550>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:46.051073 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-bd9d9110-66ba-4843-9286-f21b6b9112c8 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] HTTP exception thrown: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bd9d9110-66ba-4843-9286-f21b6b9112c8 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Request method failure captured: Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: DELETE /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321 HTTP/1.1 Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3okqYmxjt6oA7pLagPfvVfxDKNG7B_fKDSsjidJuT451QZH_XW2SmXHgwHQMn0Jr4xbnBA8g0wGBTDai_IrVVhI3vbcOg2Ar5-axWoSZdDYxNjFa35IYA9VQQCLxn567fb81OHTT2JdXKM4JcnxxHfJ4jsgNQd9xrHjtHUqFyWH9h_o Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 6ceed8120f864c4aa210ae72a2b1e9c5 Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-888425215 Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:14:46.053040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:14:46.054324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:14:46.054324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesSnapshotsTestJSON-888425215 Jul 25 12:14:46.054324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 6ceed8120f864c4aa210ae72a2b1e9c5 Jul 25 12:14:46.054324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-888425215 Jul 25 12:14:46.054324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesSnapshotsTestJSON-888425215-project Jul 25 12:14:46.054324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:14:46.054324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:14:46.054324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: b7c740c7ce2e4b3c984247b6b2b69da1 Jul 25 12:14:46.054324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesSnapshotsTestJSON-888425215-project Jul 25 12:14:46.054324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: Jul 25 12:14:46.054324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:46.054324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '9a4771ba-64bc-4e36-8511-7c09a314e321'} Jul 25 12:14:46.054324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. (HTTP 404) (Request-ID: req-4b60d6ff-83c3-4bd1-bfeb-d6280114fc7e) Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:46.055098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 12:14:46.056337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 12:14:46.057421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:14:46.058483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:46.058483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.058483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:46.058483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.058483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:46.058483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:14:46.058483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:14:46.058483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:14:46.058483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:14:46.058483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:46.058483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.060897 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bd9d9110-66ba-4843-9286-f21b6b9112c8 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Returning 404 to user: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:14:46.061751 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bd9d9110-66ba-4843-9286-f21b6b9112c8 tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321" status: 404 len: 109 microversion: 2.1 time: 0.105765 Jul 25 12:14:46.065242 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 13/27] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Jul 25 12:14:45 2022] DELETE /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:14:46.072772 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c6f28bd0-4e06-47a2-877a-c33eef7685cb tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Calling method '.version_select at 0x7f942e1e3550>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:46.129915 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-c6f28bd0-4e06-47a2-877a-c33eef7685cb tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] HTTP exception thrown: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c6f28bd0-4e06-47a2-877a-c33eef7685cb tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Request method failure captured: Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321 HTTP/1.1 Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3okqYmxjt6oA7pLagPfvVfxDKNG7B_fKDSsjidJuT451QZH_XW2SmXHgwHQMn0Jr4xbnBA8g0wGBTDai_IrVVhI3vbcOg2Ar5-axWoSZdDYxNjFa35IYA9VQQCLxn567fb81OHTT2JdXKM4JcnxxHfJ4jsgNQd9xrHjtHUqFyWH9h_o Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 6ceed8120f864c4aa210ae72a2b1e9c5 Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-888425215 Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:14:46.132180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:14:46.133438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6ceed8120f864c4aa210ae72a2b1e9c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:14:46.133438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesSnapshotsTestJSON-888425215 Jul 25 12:14:46.133438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 6ceed8120f864c4aa210ae72a2b1e9c5 Jul 25 12:14:46.133438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-888425215 Jul 25 12:14:46.133438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesSnapshotsTestJSON-888425215-project Jul 25 12:14:46.133438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:14:46.133438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:14:46.133438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: b7c740c7ce2e4b3c984247b6b2b69da1 Jul 25 12:14:46.133438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesSnapshotsTestJSON-888425215-project Jul 25 12:14:46.133438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: Jul 25 12:14:46.133438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:46.133438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': '9a4771ba-64bc-4e36-8511-7c09a314e321'} Jul 25 12:14:46.133438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. (HTTP 404) (Request-ID: req-885da2bb-77dc-4adf-92ff-a48c346e38cd) Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:46.134846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:14:46.135775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 12:14:46.137740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c6f28bd0-4e06-47a2-877a-c33eef7685cb tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] Returning 404 to user: Volume 9a4771ba-64bc-4e36-8511-7c09a314e321 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c6f28bd0-4e06-47a2-877a-c33eef7685cb tempest-VolumesSnapshotsTestJSON-888425215 tempest-VolumesSnapshotsTestJSON-888425215-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321" status: 404 len: 109 microversion: 2.1 time: 0.067108 Jul 25 12:14:46.139211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 15/28] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:14:46 2022] GET /compute/v2.1/os-volumes/9a4771ba-64bc-4e36-8511-7c09a314e321 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:14:54.060116 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-906440953", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36635bbd-0783-4ae1-9364-d8aba7145b80"}], "security_groups": [{"name": "tempest-securitygroup--2027804424"}], "key_name": "tempest-keypair-560487720", "user_data": "}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:14:54.135463 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1522036810", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:14:54.309297 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] validate_networks() for [('5fd11542-87b8-48c3-9db2-c824ddc0af2f', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:14:54.445119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] validate_networks() for [('36635bbd-0783-4ae1-9364-d8aba7145b80', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:14:55.590105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:14:55.590702 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:14:55.591122 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:14:55.591672 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:14:55.592085 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:14:55.625752 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:14:55.626236 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:14:55.627297 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:14:55.627775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:14:55.691270 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Getting quotas for project aef3a5bd8ffa43718ea02647f1f74fc8. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:14:55.716138 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Getting quotas for user d2d6f10a6fe841e5b1d12bce78f97d91 and project aef3a5bd8ffa43718ea02647f1f74fc8. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:14:55.742534 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:14:55.745774 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:14:55.795947 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=4 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:55.908153 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6ab9255a-ddbd-4bea-a34b-4fa78fe7a156 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.857357 Jul 25 12:14:55.915576 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 16/29] 10.222.0.42 () {62 vars in 1188 bytes} [Mon Jul 25 12:14:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 12:14:55.926705 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-57b35fa3-c95e-4fbd-83f6-6ed709fe9c45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:55.927367 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-57b35fa3-c95e-4fbd-83f6-6ed709fe9c45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:14:56.134093 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-57b35fa3-c95e-4fbd-83f6-6ed709fe9c45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:14:56.162103 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-57b35fa3-c95e-4fbd-83f6-6ed709fe9c45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:14:56.165206 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-57b35fa3-c95e-4fbd-83f6-6ed709fe9c45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:14:56.170953 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-57b35fa3-c95e-4fbd-83f6-6ed709fe9c45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1280 microversion: 2.20 time: 0.254058 Jul 25 12:14:56.172006 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 17/30] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:14:55 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1280 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:14:56.568060 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ba53bd26-cf27-4dd6-a740-8d19d8557b01 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Action: 'create', calling method: .version_select at 0x7f942e27bca0>, body: {"keypair": {"name": "tempest-keypair-1415531527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRDhCZmgJnsOQ+2g1Tqamh52TBgUV3k2PGgUXScL7FKY/n8Kk1CSjEhCw1d91t1UGKmDghJJPaGZQrAWPgACIyEHEgC15yeNxV8NhlsXwiq7n/5/g16M4WFd8vTk7CwNg=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:14:56.631485 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-ba53bd26-cf27-4dd6-a740-8d19d8557b01 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Getting quotas for project ce78c16fa24c475b945a64a7995c70e4. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:14:56.640898 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-ba53bd26-cf27-4dd6-a740-8d19d8557b01 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Getting quotas for user c5b98bbcc2d640de837d141f83dfe924 and project ce78c16fa24c475b945a64a7995c70e4. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:14:56.716807 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ba53bd26-cf27-4dd6-a740-8d19d8557b01 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.530920 Jul 25 12:14:56.725454 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 18/31] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Jul 25 12:14:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:56.873712 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:14:56.874262 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:14:56.874913 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:14:56.875337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:14:56.876055 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:14:56.913214 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:14:56.916171 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:14:56.922117 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:14:56.924374 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:14:56.941903 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a1771050-4ad4-4a9a-8f0d-3dfb3e642ce1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Action: 'create', calling method: .version_select at 0x7f942d0a55e0>, body: {"keypair": {"name": "tempest-keypair-1024233254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPnlEgPEX/HjbqCC569HhuHWMmbjElC8EzbfqqLLTwNKcEb2cReOkmoSBBu29f+oh/YSXFIclH0p/4Y8BL/xA3cUKox9EC6BCpzsOw0ytfAFLmzABfue+u4IPWsBabo9g=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:14:57.039412 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-a1771050-4ad4-4a9a-8f0d-3dfb3e642ce1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:14:57.041881 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Getting quotas for project 2d9f339447114912b0c92b99e028fbbf. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:14:57.047760 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Getting quotas for user a766d17b116f498fab07efb69c94e49e and project 2d9f339447114912b0c92b99e028fbbf. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:14:57.070634 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-a1771050-4ad4-4a9a-8f0d-3dfb3e642ce1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for user 3848eae5b8df48eb9816ba0d7485f7c0 and project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:14:57.072788 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:14:57.075833 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:14:57.152894 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a1771050-4ad4-4a9a-8f0d-3dfb3e642ce1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.360064 Jul 25 12:14:57.160024 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 19/32] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Jul 25 12:14:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:14:57.206065 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-43f776dd-070a-4d2d-822a-77a8f8168b75 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:57.208707 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-43f776dd-070a-4d2d-822a-77a8f8168b75 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:14:57.315930 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-42907207-f5a2-4769-a19e-ea65826255b1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.468903 Jul 25 12:14:57.316963 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 14/33] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:14:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 3471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:14:57.329810 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-358b0eb3-18e5-48db-b1bf-16218dbee87a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:57.330406 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-358b0eb3-18e5-48db-b1bf-16218dbee87a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:14:57.464555 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-43f776dd-070a-4d2d-822a-77a8f8168b75 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:14:57.492186 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-43f776dd-070a-4d2d-822a-77a8f8168b75 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:14:57.494528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-43f776dd-070a-4d2d-822a-77a8f8168b75 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:14:57.501528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-43f776dd-070a-4d2d-822a-77a8f8168b75 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1280 microversion: 2.20 time: 0.305406 Jul 25 12:14:57.523915 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 20/34] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:14:57 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1280 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:14:57.961144 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-358b0eb3-18e5-48db-b1bf-16218dbee87a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:14:57.988032 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-358b0eb3-18e5-48db-b1bf-16218dbee87a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1222 microversion: 2.1 time: 0.662314 Jul 25 12:14:57.988659 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 15/35] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:14:57 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1222 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:14:58.367942 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1426772975", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:14:58.528862 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] validate_networks() for [('5fd11542-87b8-48c3-9db2-c824ddc0af2f', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:14:58.552094 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-92698072-781e-4167-ab99-d3742b2519cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:14:58.552902 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-92698072-781e-4167-ab99-d3742b2519cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:14:58.571125 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92698072-781e-4167-ab99-d3742b2519cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:14:58.572098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92698072-781e-4167-ab99-d3742b2519cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:14:58.575124 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92698072-781e-4167-ab99-d3742b2519cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:14:58.589544 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92698072-781e-4167-ab99-d3742b2519cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:14:59.170691 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-92698072-781e-4167-ab99-d3742b2519cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:14:59.209044 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-92698072-781e-4167-ab99-d3742b2519cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:14:59.212451 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-92698072-781e-4167-ab99-d3742b2519cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:14:59.227084 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-92698072-781e-4167-ab99-d3742b2519cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1284 microversion: 2.20 time: 0.683223 Jul 25 12:14:59.245470 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 16/36] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:14:58 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1284 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:14:59.571219 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1413538491", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "networks": [{"uuid": "a511a4d3-2b90-4c1e-8d84-619387a492cd"}]}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:14:59.662858 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] validate_networks() for [('a511a4d3-2b90-4c1e-8d84-619387a492cd', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:15:00.755659 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:15:00.756705 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:15:00.758795 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:15:00.759389 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:15:00.760342 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:15:00.801988 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:00.808288 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:00.809435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:00.810233 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:00.861874 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Getting quotas for project 2d9f339447114912b0c92b99e028fbbf. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:15:00.888824 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Getting quotas for user a766d17b116f498fab07efb69c94e49e and project 2d9f339447114912b0c92b99e028fbbf. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:15:00.931076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:15:00.946551 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:15:00.960085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:15:00.961742 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:15:00.962486 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:15:00.963153 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:15:00.963792 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:15:00.987296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:00.988092 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:00.990115 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:00.991287 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:01.081043 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Getting quotas for project 05e8cdf9803c4388a79e123894ab34b1. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:15:01.114548 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Getting quotas for user 89a96a9ce9db422f96927b7f59606998 and project 05e8cdf9803c4388a79e123894ab34b1. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:15:01.157140 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e16febe3-a422-4a44-b667-704857624ac2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.790488 Jul 25 12:15:01.162827 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:15:01.163573 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 21/37] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:14:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 2800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:15:01.173651 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:15:01.183688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-857b2aaa-beca-4f8d-b86a-0f23571f0ff7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:01.186864 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-857b2aaa-beca-4f8d-b86a-0f23571f0ff7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:01.213156 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-857b2aaa-beca-4f8d-b86a-0f23571f0ff7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:01.214393 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-857b2aaa-beca-4f8d-b86a-0f23571f0ff7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:01.219273 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-857b2aaa-beca-4f8d-b86a-0f23571f0ff7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:01.219787 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-857b2aaa-beca-4f8d-b86a-0f23571f0ff7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:01.346180 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4a5c57de-ed9c-4702-abaa-42de211e7115 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.098477 Jul 25 12:15:01.359968 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 17/38] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:14:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:15:01.383052 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c8c43a33-747c-4e80-a351-50966c7bc7fb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:01.400618 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c8c43a33-747c-4e80-a351-50966c7bc7fb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:01.857235 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-857b2aaa-beca-4f8d-b86a-0f23571f0ff7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:01.884777 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-857b2aaa-beca-4f8d-b86a-0f23571f0ff7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:01.886653 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-857b2aaa-beca-4f8d-b86a-0f23571f0ff7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:01.888001 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-857b2aaa-beca-4f8d-b86a-0f23571f0ff7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1332 microversion: 2.20 time: 0.721905 Jul 25 12:15:01.889103 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 22/39] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:01 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1332 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:01.894009 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-56460e68-6cac-4357-8be2-21c1face48ab tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:01.894885 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-56460e68-6cac-4357-8be2-21c1face48ab tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:02.014679 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c8c43a33-747c-4e80-a351-50966c7bc7fb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:02.019152 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-56460e68-6cac-4357-8be2-21c1face48ab tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:02.038945 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-56460e68-6cac-4357-8be2-21c1face48ab tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1215 microversion: 2.1 time: 0.148553 Jul 25 12:15:02.077484 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c8c43a33-747c-4e80-a351-50966c7bc7fb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1222 microversion: 2.1 time: 0.715482 Jul 25 12:15:02.078342 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 18/40] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:01 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1222 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:02.101494 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 23/41] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:01 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:02.147663 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-369616957", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18a1dbad-381e-4747-8a32-f7e07d523a46"}], "security_groups": [{"name": "tempest-securitygroup--1702822060"}], "key_name": "tempest-keypair-1415531527", "user_data": "}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:02.788210 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] validate_networks() for [('18a1dbad-381e-4747-8a32-f7e07d523a46', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:15:02.917821 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dd64b019-d250-4095-b28b-54e28c267a8e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:02.918192 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dd64b019-d250-4095-b28b-54e28c267a8e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:02.930746 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd64b019-d250-4095-b28b-54e28c267a8e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:02.932640 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd64b019-d250-4095-b28b-54e28c267a8e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:02.934209 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd64b019-d250-4095-b28b-54e28c267a8e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:02.938558 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dd64b019-d250-4095-b28b-54e28c267a8e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:03.233035 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dd64b019-d250-4095-b28b-54e28c267a8e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:03.247240 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dd64b019-d250-4095-b28b-54e28c267a8e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:03.248860 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dd64b019-d250-4095-b28b-54e28c267a8e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:03.257026 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dd64b019-d250-4095-b28b-54e28c267a8e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1340 microversion: 2.20 time: 0.343834 Jul 25 12:15:03.257631 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 24/42] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:02 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1340 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:15:03.289165 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7c089d9c-d410-4d39-80ad-e3f7b88f2ba8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:03.293722 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7c089d9c-d410-4d39-80ad-e3f7b88f2ba8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:03.309792 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c089d9c-d410-4d39-80ad-e3f7b88f2ba8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:03.315173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c089d9c-d410-4d39-80ad-e3f7b88f2ba8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:03.316594 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c089d9c-d410-4d39-80ad-e3f7b88f2ba8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:03.319441 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c089d9c-d410-4d39-80ad-e3f7b88f2ba8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:03.706870 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7c089d9c-d410-4d39-80ad-e3f7b88f2ba8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:03.718775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7c089d9c-d410-4d39-80ad-e3f7b88f2ba8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1274 microversion: 2.1 time: 0.442905 Jul 25 12:15:03.721232 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 25/43] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:03 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1274 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:03.731980 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-48c2b7b0-66d8-42e9-8a5a-c7ef6cc40179 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:03.732773 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-48c2b7b0-66d8-42e9-8a5a-c7ef6cc40179 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:03.745357 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48c2b7b0-66d8-42e9-8a5a-c7ef6cc40179 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:03.748700 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48c2b7b0-66d8-42e9-8a5a-c7ef6cc40179 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:03.751568 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48c2b7b0-66d8-42e9-8a5a-c7ef6cc40179 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:03.752216 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48c2b7b0-66d8-42e9-8a5a-c7ef6cc40179 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:04.127176 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-48c2b7b0-66d8-42e9-8a5a-c7ef6cc40179 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:04.135179 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-48c2b7b0-66d8-42e9-8a5a-c7ef6cc40179 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1267 microversion: 2.1 time: 0.412201 Jul 25 12:15:04.142617 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 26/44] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:03 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1267 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:04.290080 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-116d84be-fa06-4c70-ae4a-c64fc9975301 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:04.290689 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-116d84be-fa06-4c70-ae4a-c64fc9975301 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:04.309958 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-116d84be-fa06-4c70-ae4a-c64fc9975301 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:04.314218 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-116d84be-fa06-4c70-ae4a-c64fc9975301 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:04.319271 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-116d84be-fa06-4c70-ae4a-c64fc9975301 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:04.320684 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-116d84be-fa06-4c70-ae4a-c64fc9975301 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:04.745024 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-116d84be-fa06-4c70-ae4a-c64fc9975301 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:04.760802 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-116d84be-fa06-4c70-ae4a-c64fc9975301 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:04.765893 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-116d84be-fa06-4c70-ae4a-c64fc9975301 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:04.799568 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-116d84be-fa06-4c70-ae4a-c64fc9975301 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1338 microversion: 2.20 time: 0.512111 Jul 25 12:15:04.800396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 27/45] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:04 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1338 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:04.829008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-41c3763e-304a-436c-8a89-99e1e976aa7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:04.829903 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-41c3763e-304a-436c-8a89-99e1e976aa7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:04.852175 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41c3763e-304a-436c-8a89-99e1e976aa7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:04.853467 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41c3763e-304a-436c-8a89-99e1e976aa7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:04.857066 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41c3763e-304a-436c-8a89-99e1e976aa7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:04.857726 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41c3763e-304a-436c-8a89-99e1e976aa7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:05.185989 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:15:05.186486 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:15:05.187520 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:15:05.188500 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:15:05.188635 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:15:05.217662 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:05.219779 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:05.222106 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:05.225288 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:05.275420 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Getting quotas for project ce78c16fa24c475b945a64a7995c70e4. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:15:05.297938 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Getting quotas for user c5b98bbcc2d640de837d141f83dfe924 and project ce78c16fa24c475b945a64a7995c70e4. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:15:05.363273 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:15:05.375890 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:15:05.600653 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ad827d01-8410-4055-98ba-eb47c960f1ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.487772 Jul 25 12:15:05.603193 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 19/46] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:15:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 3504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:15:05.608825 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3f3aca8d-f056-4e01-9c41-38fa234d491b tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:05.612326 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3f3aca8d-f056-4e01-9c41-38fa234d491b tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:05.644396 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3f3aca8d-f056-4e01-9c41-38fa234d491b tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:05.644934 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3f3aca8d-f056-4e01-9c41-38fa234d491b tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:05.645763 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3f3aca8d-f056-4e01-9c41-38fa234d491b tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:05.646206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3f3aca8d-f056-4e01-9c41-38fa234d491b tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:05.912861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-41c3763e-304a-436c-8a89-99e1e976aa7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:05.928120 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-41c3763e-304a-436c-8a89-99e1e976aa7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1280 microversion: 2.1 time: 1.126300 Jul 25 12:15:05.929018 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 28/47] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:04 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1280 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:05.947831 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cb8df79a-bd7a-4f78-8aca-42bfd14a9e0a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:05.948627 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cb8df79a-bd7a-4f78-8aca-42bfd14a9e0a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:06.301964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cb8df79a-bd7a-4f78-8aca-42bfd14a9e0a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:06.320183 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cb8df79a-bd7a-4f78-8aca-42bfd14a9e0a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1237 microversion: 2.1 time: 0.389940 Jul 25 12:15:06.323923 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 29/48] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:05 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1237 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:06.349528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6355f841-92a4-4fb5-9d84-378fac7db223 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:06.353309 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6355f841-92a4-4fb5-9d84-378fac7db223 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:06.374702 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6355f841-92a4-4fb5-9d84-378fac7db223 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:06.379986 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6355f841-92a4-4fb5-9d84-378fac7db223 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:06.384258 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6355f841-92a4-4fb5-9d84-378fac7db223 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:06.385154 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6355f841-92a4-4fb5-9d84-378fac7db223 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:06.534234 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3f3aca8d-f056-4e01-9c41-38fa234d491b tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:06.546014 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3f3aca8d-f056-4e01-9c41-38fa234d491b tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1273 microversion: 2.1 time: 0.939167 Jul 25 12:15:06.548489 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 20/49] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:05 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1273 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:06.801043 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6355f841-92a4-4fb5-9d84-378fac7db223 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:06.846998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6355f841-92a4-4fb5-9d84-378fac7db223 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:06.860340 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6355f841-92a4-4fb5-9d84-378fac7db223 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:06.863990 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6355f841-92a4-4fb5-9d84-378fac7db223 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1338 microversion: 2.20 time: 0.537515 Jul 25 12:15:06.868754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 30/50] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:06 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1338 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:06.955904 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-72dc8705-eaa1-4020-ba0c-ece4eb8170a0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:06.956620 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-72dc8705-eaa1-4020-ba0c-ece4eb8170a0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:06.959096 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=10 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:06.969677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72dc8705-eaa1-4020-ba0c-ece4eb8170a0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:06.970133 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72dc8705-eaa1-4020-ba0c-ece4eb8170a0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:06.970918 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72dc8705-eaa1-4020-ba0c-ece4eb8170a0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:06.984744 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-72dc8705-eaa1-4020-ba0c-ece4eb8170a0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:07.350798 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-97709d24-657f-4267-9a46-f71f1fa4b214 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:07.351612 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-97709d24-657f-4267-9a46-f71f1fa4b214 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:07.393227 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97709d24-657f-4267-9a46-f71f1fa4b214 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:07.397176 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97709d24-657f-4267-9a46-f71f1fa4b214 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:07.403407 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97709d24-657f-4267-9a46-f71f1fa4b214 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:07.406023 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97709d24-657f-4267-9a46-f71f1fa4b214 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:07.761283 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-72dc8705-eaa1-4020-ba0c-ece4eb8170a0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:07.783766 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-72dc8705-eaa1-4020-ba0c-ece4eb8170a0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1280 microversion: 2.1 time: 0.829705 Jul 25 12:15:07.784687 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 21/51] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:06 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1280 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:07.803935 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-212644e1-9c9d-432a-8758-ad5096033712 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:07.806164 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-212644e1-9c9d-432a-8758-ad5096033712 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:07.857734 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-212644e1-9c9d-432a-8758-ad5096033712 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:07.858514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-212644e1-9c9d-432a-8758-ad5096033712 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:07.860740 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-212644e1-9c9d-432a-8758-ad5096033712 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:07.862006 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-212644e1-9c9d-432a-8758-ad5096033712 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:08.069141 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-97709d24-657f-4267-9a46-f71f1fa4b214 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:08.084407 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-97709d24-657f-4267-9a46-f71f1fa4b214 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1289 microversion: 2.1 time: 0.740747 Jul 25 12:15:08.085228 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 31/52] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:07 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1289 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:08.091088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3801eca7-1419-45ec-8289-7d05a7ef2ca1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:08.097335 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-212644e1-9c9d-432a-8758-ad5096033712 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:08.100610 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3801eca7-1419-45ec-8289-7d05a7ef2ca1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:08.123267 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3801eca7-1419-45ec-8289-7d05a7ef2ca1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:08.123986 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3801eca7-1419-45ec-8289-7d05a7ef2ca1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:08.124929 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3801eca7-1419-45ec-8289-7d05a7ef2ca1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:08.125367 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3801eca7-1419-45ec-8289-7d05a7ef2ca1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:08.126265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-212644e1-9c9d-432a-8758-ad5096033712 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1273 microversion: 2.1 time: 0.337550 Jul 25 12:15:08.127401 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 22/53] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:07 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:08.144391 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1744739001", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6bc64d3-b55c-4e64-a050-b439cd834684"}], "security_groups": [{"name": "tempest-securitygroup--430572945"}], "key_name": "tempest-keypair-1024233254", "user_data": "}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:08.699166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] validate_networks() for [('b6bc64d3-b55c-4e64-a050-b439cd834684', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:15:10.832545 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:11.010254 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3801eca7-1419-45ec-8289-7d05a7ef2ca1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:11.048094 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3801eca7-1419-45ec-8289-7d05a7ef2ca1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:11.050586 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3801eca7-1419-45ec-8289-7d05a7ef2ca1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:11.052803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3801eca7-1419-45ec-8289-7d05a7ef2ca1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 2.965133 Jul 25 12:15:11.053976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 32/54] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:08 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 2968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:11.059244 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-716e891c-c160-45d4-9188-5c5ba56e18d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:11.060282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-716e891c-c160-45d4-9188-5c5ba56e18d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:11.066815 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-716e891c-c160-45d4-9188-5c5ba56e18d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:11.067920 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-716e891c-c160-45d4-9188-5c5ba56e18d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:11.068976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-716e891c-c160-45d4-9188-5c5ba56e18d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:11.069868 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-716e891c-c160-45d4-9188-5c5ba56e18d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:12.048958 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-716e891c-c160-45d4-9188-5c5ba56e18d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:12.057622 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-716e891c-c160-45d4-9188-5c5ba56e18d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1322 microversion: 2.1 time: 1.001876 Jul 25 12:15:12.064126 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 33/55] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:11 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1322 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:12.080111 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a0843093-5c4b-4f38-b0c9-c99ccf4ed54e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:12.086508 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a0843093-5c4b-4f38-b0c9-c99ccf4ed54e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:12.102031 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0843093-5c4b-4f38-b0c9-c99ccf4ed54e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:12.111462 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0843093-5c4b-4f38-b0c9-c99ccf4ed54e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:12.125250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0843093-5c4b-4f38-b0c9-c99ccf4ed54e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:12.125998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0843093-5c4b-4f38-b0c9-c99ccf4ed54e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:12.229391 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:15:12.230593 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:15:12.231231 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:15:12.231822 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:15:12.233435 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:15:12.258813 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:12.259420 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:12.261259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:12.263838 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:12.305500 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:15:12.310555 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for user 3848eae5b8df48eb9816ba0d7485f7c0 and project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:15:12.326216 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:15:12.329892 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:15:12.420450 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-157ef5ba-6122-4046-bb9b-9bf336e49ea9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.289819 Jul 25 12:15:12.421532 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 23/56] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:15:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 4292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:15:12.433343 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-abe49e24-8cfa-423b-8d18-e55b5cea698e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:12.434886 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-abe49e24-8cfa-423b-8d18-e55b5cea698e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:12.449985 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-abe49e24-8cfa-423b-8d18-e55b5cea698e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:12.451085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-abe49e24-8cfa-423b-8d18-e55b5cea698e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:12.453106 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-abe49e24-8cfa-423b-8d18-e55b5cea698e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:12.454100 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-abe49e24-8cfa-423b-8d18-e55b5cea698e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:12.635094 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a0843093-5c4b-4f38-b0c9-c99ccf4ed54e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:12.668855 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a0843093-5c4b-4f38-b0c9-c99ccf4ed54e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1295 microversion: 2.1 time: 0.598477 Jul 25 12:15:12.682678 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 34/57] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:12 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1295 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:12.707596 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8c62154c-14d7-477e-94dc-7e68b4ad6c52 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:12.708758 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8c62154c-14d7-477e-94dc-7e68b4ad6c52 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:12.758690 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c62154c-14d7-477e-94dc-7e68b4ad6c52 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:12.759822 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c62154c-14d7-477e-94dc-7e68b4ad6c52 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:12.762410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c62154c-14d7-477e-94dc-7e68b4ad6c52 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:12.773140 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c62154c-14d7-477e-94dc-7e68b4ad6c52 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:13.568335 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-abe49e24-8cfa-423b-8d18-e55b5cea698e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:13.581606 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-abe49e24-8cfa-423b-8d18-e55b5cea698e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1315 microversion: 2.1 time: 1.152534 Jul 25 12:15:13.591691 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 24/58] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:12 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1315 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:13.612257 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ac9097cf-9ba6-4506-8c21-62fe6746105a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:13.614180 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ac9097cf-9ba6-4506-8c21-62fe6746105a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:13.635684 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ac9097cf-9ba6-4506-8c21-62fe6746105a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:13.636563 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ac9097cf-9ba6-4506-8c21-62fe6746105a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:13.637548 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ac9097cf-9ba6-4506-8c21-62fe6746105a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:13.638126 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ac9097cf-9ba6-4506-8c21-62fe6746105a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:14.304294 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ac9097cf-9ba6-4506-8c21-62fe6746105a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:14.319865 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ac9097cf-9ba6-4506-8c21-62fe6746105a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1246 microversion: 2.1 time: 0.726383 Jul 25 12:15:14.322711 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 25/59] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:13 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1246 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:14.342381 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-312ca1b1-0458-43a4-bf30-ba29d9e95c32 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:14.344404 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-312ca1b1-0458-43a4-bf30-ba29d9e95c32 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:14.380867 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-312ca1b1-0458-43a4-bf30-ba29d9e95c32 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:14.381867 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-312ca1b1-0458-43a4-bf30-ba29d9e95c32 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:14.383498 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-312ca1b1-0458-43a4-bf30-ba29d9e95c32 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:14.384503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-312ca1b1-0458-43a4-bf30-ba29d9e95c32 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:15.104352 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-312ca1b1-0458-43a4-bf30-ba29d9e95c32 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:15.113809 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-312ca1b1-0458-43a4-bf30-ba29d9e95c32 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1322 microversion: 2.1 time: 0.775960 Jul 25 12:15:15.118139 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 26/60] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:14 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:15.128282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8c62154c-14d7-477e-94dc-7e68b4ad6c52 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:15.137616 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8c62154c-14d7-477e-94dc-7e68b4ad6c52 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:15.156623 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8f782d55-6194-455e-b27e-02f23b713f5b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:15.158157 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8f782d55-6194-455e-b27e-02f23b713f5b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:15.168256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8c62154c-14d7-477e-94dc-7e68b4ad6c52 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:15.169967 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8c62154c-14d7-477e-94dc-7e68b4ad6c52 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 2.484374 Jul 25 12:15:15.173398 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 35/61] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:12 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 2487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:15.184835 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2d287774-5756-4323-ac2f-ac4115c9562f tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:15.191215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f782d55-6194-455e-b27e-02f23b713f5b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:15.192120 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f782d55-6194-455e-b27e-02f23b713f5b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:15.192928 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2d287774-5756-4323-ac2f-ac4115c9562f tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:15.196524 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f782d55-6194-455e-b27e-02f23b713f5b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:15.198763 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:15.199703 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f782d55-6194-455e-b27e-02f23b713f5b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:15.228686 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2d287774-5756-4323-ac2f-ac4115c9562f tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:15.229138 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2d287774-5756-4323-ac2f-ac4115c9562f tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:15.229923 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2d287774-5756-4323-ac2f-ac4115c9562f tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:15.230357 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2d287774-5756-4323-ac2f-ac4115c9562f tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:15.932034 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2d287774-5756-4323-ac2f-ac4115c9562f tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:15.947280 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2d287774-5756-4323-ac2f-ac4115c9562f tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1315 microversion: 2.1 time: 0.772549 Jul 25 12:15:15.948161 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 36/62] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:15 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:16.223622 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8f782d55-6194-455e-b27e-02f23b713f5b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:16.260725 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8f782d55-6194-455e-b27e-02f23b713f5b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1295 microversion: 2.1 time: 1.137155 Jul 25 12:15:16.266729 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 27/63] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:15 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1295 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:16.305881 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-053a6725-b75a-41bf-9bbc-baf9cd4a3ccc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:16.307875 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=28 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:16.319469 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-053a6725-b75a-41bf-9bbc-baf9cd4a3ccc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:16.359446 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-053a6725-b75a-41bf-9bbc-baf9cd4a3ccc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:16.360015 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-053a6725-b75a-41bf-9bbc-baf9cd4a3ccc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:16.360854 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-053a6725-b75a-41bf-9bbc-baf9cd4a3ccc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:16.361299 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-053a6725-b75a-41bf-9bbc-baf9cd4a3ccc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:16.696970 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-0cddb4c6-9d6c-46bd-a832-338dde1dad43 req-d0e9a2f5-9553-46cc-a0e9-356a7357da9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca94ee8-647e-426e-a219-a1bb3cf33deb", "tag": "7f197314-d0da-4b94-8f2d-39d9013c44e2"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:16.732213 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-0cddb4c6-9d6c-46bd-a832-338dde1dad43 req-d0e9a2f5-9553-46cc-a0e9-356a7357da9f service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:16.734314 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-0cddb4c6-9d6c-46bd-a832-338dde1dad43 req-d0e9a2f5-9553-46cc-a0e9-356a7357da9f service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:16.838054 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-0cddb4c6-9d6c-46bd-a832-338dde1dad43 req-d0e9a2f5-9553-46cc-a0e9-356a7357da9f service nova] Creating event network-changed:7f197314-d0da-4b94-8f2d-39d9013c44e2 for instance eca94ee8-647e-426e-a219-a1bb3cf33deb on hv-cinder-79760 Jul 25 12:15:16.838788 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-0cddb4c6-9d6c-46bd-a832-338dde1dad43 req-d0e9a2f5-9553-46cc-a0e9-356a7357da9f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:15:16.846105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c5423864-9cec-4832-a7c2-3fb373e4d375 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:16.846600 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c5423864-9cec-4832-a7c2-3fb373e4d375 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:16.847468 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c5423864-9cec-4832-a7c2-3fb373e4d375 None None] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:16.847934 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c5423864-9cec-4832-a7c2-3fb373e4d375 None None] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:16.883256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.compute.rpcapi [None req-c5423864-9cec-4832-a7c2-3fb373e4d375 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 12:15:16.891038 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c5423864-9cec-4832-a7c2-3fb373e4d375 None None] Releasing lock "compute-rpcapi-router" {{(pid=117776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:15:16.942893 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c5423864-9cec-4832-a7c2-3fb373e4d375 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.977894 Jul 25 12:15:16.943920 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 37/64] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:15:16.950451 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6d81c418-f399-4e75-a2a2-4ed7fa56e261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:16.952907 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6d81c418-f399-4e75-a2a2-4ed7fa56e261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:16.975873 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d81c418-f399-4e75-a2a2-4ed7fa56e261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:16.977636 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d81c418-f399-4e75-a2a2-4ed7fa56e261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:16.979812 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d81c418-f399-4e75-a2a2-4ed7fa56e261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:16.981015 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6d81c418-f399-4e75-a2a2-4ed7fa56e261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:17.325786 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-053a6725-b75a-41bf-9bbc-baf9cd4a3ccc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:17.335099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-053a6725-b75a-41bf-9bbc-baf9cd4a3ccc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1300 microversion: 2.1 time: 1.065198 Jul 25 12:15:17.336245 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 28/65] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:16 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1300 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:17.370445 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ae407e78-f759-4c77-8526-9c680e930215 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:17.372920 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ae407e78-f759-4c77-8526-9c680e930215 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:17.390491 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae407e78-f759-4c77-8526-9c680e930215 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:17.394170 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae407e78-f759-4c77-8526-9c680e930215 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:17.397446 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae407e78-f759-4c77-8526-9c680e930215 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:17.399133 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae407e78-f759-4c77-8526-9c680e930215 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:18.615082 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6d81c418-f399-4e75-a2a2-4ed7fa56e261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:18.632190 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6d81c418-f399-4e75-a2a2-4ed7fa56e261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1322 microversion: 2.1 time: 1.686895 Jul 25 12:15:18.639041 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 38/66] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:16 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1322 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:18.657691 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1ab913d7-7782-47fc-b37f-67645bb1d4aa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:18.665623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1ab913d7-7782-47fc-b37f-67645bb1d4aa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:18.682059 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ab913d7-7782-47fc-b37f-67645bb1d4aa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:18.684126 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ab913d7-7782-47fc-b37f-67645bb1d4aa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:18.685262 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ab913d7-7782-47fc-b37f-67645bb1d4aa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:18.686040 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ab913d7-7782-47fc-b37f-67645bb1d4aa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:18.951707 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ae407e78-f759-4c77-8526-9c680e930215 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:18.968060 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ae407e78-f759-4c77-8526-9c680e930215 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:18.970281 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ae407e78-f759-4c77-8526-9c680e930215 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:18.972073 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ae407e78-f759-4c77-8526-9c680e930215 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 1.621919 Jul 25 12:15:18.974149 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 29/67] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:17 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:19.007037 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-372765bb-15ee-4340-8df9-2fdd5b24517b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:19.010580 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-372765bb-15ee-4340-8df9-2fdd5b24517b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:19.031148 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-372765bb-15ee-4340-8df9-2fdd5b24517b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:19.031618 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-372765bb-15ee-4340-8df9-2fdd5b24517b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:19.040070 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-372765bb-15ee-4340-8df9-2fdd5b24517b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:19.041576 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-372765bb-15ee-4340-8df9-2fdd5b24517b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:19.253163 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-372765bb-15ee-4340-8df9-2fdd5b24517b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:19.264431 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-372765bb-15ee-4340-8df9-2fdd5b24517b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1295 microversion: 2.1 time: 0.285661 Jul 25 12:15:19.280128 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 30/68] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:18 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1295 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:19.296791 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-51d5a71b-b128-414a-9b28-9dc8071a2343 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:19.297651 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-51d5a71b-b128-414a-9b28-9dc8071a2343 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:19.307135 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51d5a71b-b128-414a-9b28-9dc8071a2343 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:19.307678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51d5a71b-b128-414a-9b28-9dc8071a2343 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:19.308477 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51d5a71b-b128-414a-9b28-9dc8071a2343 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:19.308907 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51d5a71b-b128-414a-9b28-9dc8071a2343 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:19.471300 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-51d5a71b-b128-414a-9b28-9dc8071a2343 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:19.480392 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-51d5a71b-b128-414a-9b28-9dc8071a2343 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1300 microversion: 2.1 time: 0.197445 Jul 25 12:15:19.495627 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 31/69] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:19 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1300 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:19.577601 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1ab913d7-7782-47fc-b37f-67645bb1d4aa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:19.588742 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1ab913d7-7782-47fc-b37f-67645bb1d4aa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1315 microversion: 2.1 time: 0.948426 Jul 25 12:15:19.590602 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 39/70] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:18 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1315 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:19.595913 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-7d7a69ed-d3df-421b-8cad-d6981d78723c req-689c02d0-49dd-44f2-87f5-ffe7535f9970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03ec6126-ab67-4094-ade6-816f0e39ba46", "tag": "3b24bc1b-53c9-4417-92af-4eb343429851"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:19.614945 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-7d7a69ed-d3df-421b-8cad-d6981d78723c req-689c02d0-49dd-44f2-87f5-ffe7535f9970 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:19.615684 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-7d7a69ed-d3df-421b-8cad-d6981d78723c req-689c02d0-49dd-44f2-87f5-ffe7535f9970 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:19.622122 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:19.633382 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-7d7a69ed-d3df-421b-8cad-d6981d78723c req-689c02d0-49dd-44f2-87f5-ffe7535f9970 service nova] Creating event network-changed:3b24bc1b-53c9-4417-92af-4eb343429851 for instance 03ec6126-ab67-4094-ade6-816f0e39ba46 on hv-cinder-79760 Jul 25 12:15:19.641312 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-7d7a69ed-d3df-421b-8cad-d6981d78723c req-689c02d0-49dd-44f2-87f5-ffe7535f9970 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049003 Jul 25 12:15:19.642335 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 40/71] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:15:19.656543 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2d8ecca9-cef9-4418-ae19-b9d5f51233af tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:19.658917 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2d8ecca9-cef9-4418-ae19-b9d5f51233af tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:19.677025 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2d8ecca9-cef9-4418-ae19-b9d5f51233af tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:19.678561 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2d8ecca9-cef9-4418-ae19-b9d5f51233af tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:19.680632 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2d8ecca9-cef9-4418-ae19-b9d5f51233af tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:19.682285 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2d8ecca9-cef9-4418-ae19-b9d5f51233af tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:19.873366 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-37edc087-7587-4094-8b3e-80d46bf67bac req-fccf2f93-b913-4163-bb1e-35c1e5816c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9644e94-ac1d-497c-868e-36945ba75fa6", "tag": "c8918714-06f3-4c5f-bc49-913ec7c6960a"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:19.899820 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-37edc087-7587-4094-8b3e-80d46bf67bac req-fccf2f93-b913-4163-bb1e-35c1e5816c9d service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:19.900252 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-37edc087-7587-4094-8b3e-80d46bf67bac req-fccf2f93-b913-4163-bb1e-35c1e5816c9d service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:19.932657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-37edc087-7587-4094-8b3e-80d46bf67bac req-fccf2f93-b913-4163-bb1e-35c1e5816c9d service nova] Creating event network-changed:c8918714-06f3-4c5f-bc49-913ec7c6960a for instance c9644e94-ac1d-497c-868e-36945ba75fa6 on hv-cinder-79760 Jul 25 12:15:19.933155 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-37edc087-7587-4094-8b3e-80d46bf67bac req-fccf2f93-b913-4163-bb1e-35c1e5816c9d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:15:19.934990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-042f89d7-f87e-4a58-a924-b5276143bc87 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:19.935756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-042f89d7-f87e-4a58-a924-b5276143bc87 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:19.936954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-042f89d7-f87e-4a58-a924-b5276143bc87 None None] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:19.938084 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-042f89d7-f87e-4a58-a924-b5276143bc87 None None] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:19.949352 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.compute.rpcapi [None req-042f89d7-f87e-4a58-a924-b5276143bc87 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 12:15:19.950452 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-042f89d7-f87e-4a58-a924-b5276143bc87 None None] Releasing lock "compute-rpcapi-router" {{(pid=117777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:15:19.973107 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-042f89d7-f87e-4a58-a924-b5276143bc87 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.475421 Jul 25 12:15:19.975536 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 32/72] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:15:20.006649 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1752857f-ef69-46b0-9d4d-8e751ab618c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:20.010410 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1752857f-ef69-46b0-9d4d-8e751ab618c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:20.021197 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1752857f-ef69-46b0-9d4d-8e751ab618c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:20.021652 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1752857f-ef69-46b0-9d4d-8e751ab618c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:20.022451 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1752857f-ef69-46b0-9d4d-8e751ab618c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:20.024102 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1752857f-ef69-46b0-9d4d-8e751ab618c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:20.194770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1752857f-ef69-46b0-9d4d-8e751ab618c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:20.210852 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1752857f-ef69-46b0-9d4d-8e751ab618c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:20.214353 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1752857f-ef69-46b0-9d4d-8e751ab618c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:20.217322 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1752857f-ef69-46b0-9d4d-8e751ab618c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 0.219138 Jul 25 12:15:20.218103 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 33/73] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:19 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:20.274491 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2d8ecca9-cef9-4418-ae19-b9d5f51233af tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:20.282894 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2d8ecca9-cef9-4418-ae19-b9d5f51233af tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1322 microversion: 2.1 time: 0.630898 Jul 25 12:15:20.298907 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 41/74] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:19 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1322 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:20.302564 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5507db97-2490-4f2a-9ffe-bafb53822879 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:20.303841 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5507db97-2490-4f2a-9ffe-bafb53822879 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:20.316471 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5507db97-2490-4f2a-9ffe-bafb53822879 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:20.316993 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5507db97-2490-4f2a-9ffe-bafb53822879 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:20.317884 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5507db97-2490-4f2a-9ffe-bafb53822879 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:20.318697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5507db97-2490-4f2a-9ffe-bafb53822879 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:20.504233 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-22f24d21-4295-4c8a-9db8-e572b06b1281 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:20.505431 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-22f24d21-4295-4c8a-9db8-e572b06b1281 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:20.516646 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5507db97-2490-4f2a-9ffe-bafb53822879 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:20.516849 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22f24d21-4295-4c8a-9db8-e572b06b1281 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:20.520278 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22f24d21-4295-4c8a-9db8-e572b06b1281 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:20.521217 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22f24d21-4295-4c8a-9db8-e572b06b1281 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:20.521661 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22f24d21-4295-4c8a-9db8-e572b06b1281 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:20.525137 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5507db97-2490-4f2a-9ffe-bafb53822879 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1363 microversion: 2.1 time: 0.240591 Jul 25 12:15:20.525739 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 34/75] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:20 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:20.614611 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e0531f0a-641c-48bb-afaa-394f993d8bab tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:20.617523 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e0531f0a-641c-48bb-afaa-394f993d8bab tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:20.624602 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0531f0a-641c-48bb-afaa-394f993d8bab tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:20.625295 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0531f0a-641c-48bb-afaa-394f993d8bab tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:20.626074 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0531f0a-641c-48bb-afaa-394f993d8bab tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:20.626504 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0531f0a-641c-48bb-afaa-394f993d8bab tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:20.657332 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:20.864625 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e0531f0a-641c-48bb-afaa-394f993d8bab tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:20.873433 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e0531f0a-641c-48bb-afaa-394f993d8bab tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1315 microversion: 2.1 time: 0.265664 Jul 25 12:15:20.874061 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 35/76] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:20 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:21.004543 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-22f24d21-4295-4c8a-9db8-e572b06b1281 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:21.017916 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-22f24d21-4295-4c8a-9db8-e572b06b1281 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1367 microversion: 2.1 time: 0.517656 Jul 25 12:15:21.018517 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 42/77] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:20 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1367 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:21.246749 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e9f726b9-da61-4807-a15d-de5cd303cc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:21.251306 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e9f726b9-da61-4807-a15d-de5cd303cc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:21.270123 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e9f726b9-da61-4807-a15d-de5cd303cc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:21.273991 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e9f726b9-da61-4807-a15d-de5cd303cc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:21.275021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e9f726b9-da61-4807-a15d-de5cd303cc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:21.280634 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e9f726b9-da61-4807-a15d-de5cd303cc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:21.305850 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-480570b9-edf6-4b4e-af30-957690447d9b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:21.306572 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-480570b9-edf6-4b4e-af30-957690447d9b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:21.330947 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-480570b9-edf6-4b4e-af30-957690447d9b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:21.331389 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-480570b9-edf6-4b4e-af30-957690447d9b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:21.332214 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-480570b9-edf6-4b4e-af30-957690447d9b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:21.332626 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-480570b9-edf6-4b4e-af30-957690447d9b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:21.597761 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e9f726b9-da61-4807-a15d-de5cd303cc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:21.613833 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e9f726b9-da61-4807-a15d-de5cd303cc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:21.621838 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e9f726b9-da61-4807-a15d-de5cd303cc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:21.623250 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e9f726b9-da61-4807-a15d-de5cd303cc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 0.387376 Jul 25 12:15:21.636312 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 36/78] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:21 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:21.643647 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cd0aa101-0543-434b-a324-2ff33876c090 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:21.644277 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cd0aa101-0543-434b-a324-2ff33876c090 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:21.655823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd0aa101-0543-434b-a324-2ff33876c090 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:21.656972 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd0aa101-0543-434b-a324-2ff33876c090 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:21.658305 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd0aa101-0543-434b-a324-2ff33876c090 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:21.658922 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd0aa101-0543-434b-a324-2ff33876c090 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:22.208067 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cd0aa101-0543-434b-a324-2ff33876c090 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:22.221981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cd0aa101-0543-434b-a324-2ff33876c090 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1363 microversion: 2.1 time: 0.581995 Jul 25 12:15:22.225955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 37/79] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:21 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1363 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:22.242799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-106c4e09-9595-4c73-afc7-386af0af260e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:22.243583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-106c4e09-9595-4c73-afc7-386af0af260e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:22.250513 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-106c4e09-9595-4c73-afc7-386af0af260e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:22.251153 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-106c4e09-9595-4c73-afc7-386af0af260e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:22.251741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-106c4e09-9595-4c73-afc7-386af0af260e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:22.254769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-106c4e09-9595-4c73-afc7-386af0af260e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:22.324866 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=28 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:22.500918 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-480570b9-edf6-4b4e-af30-957690447d9b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:22.518886 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-480570b9-edf6-4b4e-af30-957690447d9b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1322 microversion: 2.1 time: 1.217377 Jul 25 12:15:22.533321 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 43/80] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:21 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1322 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:22.538666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1aa277eb-07a3-4ec3-a63c-aaa9444afc66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:22.539799 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1aa277eb-07a3-4ec3-a63c-aaa9444afc66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:22.547114 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1aa277eb-07a3-4ec3-a63c-aaa9444afc66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:22.548746 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1aa277eb-07a3-4ec3-a63c-aaa9444afc66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:22.550301 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1aa277eb-07a3-4ec3-a63c-aaa9444afc66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:22.550740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1aa277eb-07a3-4ec3-a63c-aaa9444afc66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:22.985627 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-106c4e09-9595-4c73-afc7-386af0af260e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:22.989895 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1aa277eb-07a3-4ec3-a63c-aaa9444afc66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:22.995820 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-106c4e09-9595-4c73-afc7-386af0af260e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1315 microversion: 2.1 time: 0.768382 Jul 25 12:15:23.002763 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1aa277eb-07a3-4ec3-a63c-aaa9444afc66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1367 microversion: 2.1 time: 0.471325 Jul 25 12:15:23.010315 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 38/81] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:22 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1315 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:23.016624 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 44/82] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:22 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1367 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:23.017082 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-d147b5bf-14c3-4e59-9b31-88a3486ed198 req-df565130-90d4-408a-b426-933d01c76688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66654721-31e2-48d8-a0ea-c146d277ab47", "tag": "d01f3ff0-df08-4605-a057-7920ee080060"}, {"name": "network-changed", "server_uuid": "8ea750ca-a1eb-4a15-ad78-dddfc62d8d13", "tag": "f2fd4c6c-baa4-4900-8f20-a81e46e1b234"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:23.022999 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a52bf34e-d03b-474f-aaee-a0330dd9bcd2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:23.023924 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a52bf34e-d03b-474f-aaee-a0330dd9bcd2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:23.029249 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-d147b5bf-14c3-4e59-9b31-88a3486ed198 req-df565130-90d4-408a-b426-933d01c76688 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:23.029249 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-d147b5bf-14c3-4e59-9b31-88a3486ed198 req-df565130-90d4-408a-b426-933d01c76688 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:23.032233 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a52bf34e-d03b-474f-aaee-a0330dd9bcd2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:23.032785 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a52bf34e-d03b-474f-aaee-a0330dd9bcd2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:23.033763 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a52bf34e-d03b-474f-aaee-a0330dd9bcd2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:23.034397 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a52bf34e-d03b-474f-aaee-a0330dd9bcd2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:23.047389 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-d147b5bf-14c3-4e59-9b31-88a3486ed198 req-df565130-90d4-408a-b426-933d01c76688 service nova] Creating event network-changed:d01f3ff0-df08-4605-a057-7920ee080060 for instance 66654721-31e2-48d8-a0ea-c146d277ab47 on hv-cinder-79760 Jul 25 12:15:23.047960 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-d147b5bf-14c3-4e59-9b31-88a3486ed198 req-df565130-90d4-408a-b426-933d01c76688 service nova] Creating event network-changed:f2fd4c6c-baa4-4900-8f20-a81e46e1b234 for instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 on hv-cinder-79760 Jul 25 12:15:23.055575 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-d147b5bf-14c3-4e59-9b31-88a3486ed198 req-df565130-90d4-408a-b426-933d01c76688 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043252 Jul 25 12:15:23.056174 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 39/83] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:15:23.250638 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8db79efc-e77a-495e-b21b-99d2301c226f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:23.251776 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8db79efc-e77a-495e-b21b-99d2301c226f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:23.258876 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8db79efc-e77a-495e-b21b-99d2301c226f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:23.259723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8db79efc-e77a-495e-b21b-99d2301c226f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:23.261951 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8db79efc-e77a-495e-b21b-99d2301c226f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:23.262484 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8db79efc-e77a-495e-b21b-99d2301c226f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:23.301154 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a52bf34e-d03b-474f-aaee-a0330dd9bcd2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:23.313981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a52bf34e-d03b-474f-aaee-a0330dd9bcd2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:23.321167 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a52bf34e-d03b-474f-aaee-a0330dd9bcd2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:23.323305 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a52bf34e-d03b-474f-aaee-a0330dd9bcd2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 0.305464 Jul 25 12:15:23.338465 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 45/84] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:23 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:23.529474 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8db79efc-e77a-495e-b21b-99d2301c226f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:23.541913 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8db79efc-e77a-495e-b21b-99d2301c226f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1363 microversion: 2.1 time: 0.296309 Jul 25 12:15:23.552110 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a9d80e5f-ea29-4fda-afe9-038ac84c62b0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:23.553526 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a9d80e5f-ea29-4fda-afe9-038ac84c62b0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:23.560871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 40/85] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:23 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:23.570757 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9d80e5f-ea29-4fda-afe9-038ac84c62b0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:23.571289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9d80e5f-ea29-4fda-afe9-038ac84c62b0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:23.572078 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9d80e5f-ea29-4fda-afe9-038ac84c62b0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:23.576938 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9d80e5f-ea29-4fda-afe9-038ac84c62b0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:24.016437 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0eec9154-427b-47e0-9f39-4a1af23eb6d5 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:24.017098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0eec9154-427b-47e0-9f39-4a1af23eb6d5 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:24.026622 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0eec9154-427b-47e0-9f39-4a1af23eb6d5 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:24.027074 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0eec9154-427b-47e0-9f39-4a1af23eb6d5 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:24.035578 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0eec9154-427b-47e0-9f39-4a1af23eb6d5 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:24.036294 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0eec9154-427b-47e0-9f39-4a1af23eb6d5 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:24.159777 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a9d80e5f-ea29-4fda-afe9-038ac84c62b0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:24.172277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a9d80e5f-ea29-4fda-afe9-038ac84c62b0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1322 microversion: 2.1 time: 0.634006 Jul 25 12:15:24.173456 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 46/86] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:23 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1322 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:24.180902 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-577db31d-eff5-4c7d-8833-b6ea26b8d5a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:24.181858 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-577db31d-eff5-4c7d-8833-b6ea26b8d5a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:24.189725 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-577db31d-eff5-4c7d-8833-b6ea26b8d5a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:24.190440 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-577db31d-eff5-4c7d-8833-b6ea26b8d5a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:24.191756 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-577db31d-eff5-4c7d-8833-b6ea26b8d5a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:24.192838 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-577db31d-eff5-4c7d-8833-b6ea26b8d5a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:24.278815 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0eec9154-427b-47e0-9f39-4a1af23eb6d5 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:24.290005 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0eec9154-427b-47e0-9f39-4a1af23eb6d5 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1315 microversion: 2.1 time: 0.277229 Jul 25 12:15:24.292237 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 41/87] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:24 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:24.353444 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0e606a62-a55a-415d-94cf-3479446a023c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:24.354083 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0e606a62-a55a-415d-94cf-3479446a023c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:24.364928 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e606a62-a55a-415d-94cf-3479446a023c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:24.365513 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e606a62-a55a-415d-94cf-3479446a023c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:24.367407 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e606a62-a55a-415d-94cf-3479446a023c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:24.368106 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e606a62-a55a-415d-94cf-3479446a023c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:24.648840 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0e606a62-a55a-415d-94cf-3479446a023c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:24.662695 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0e606a62-a55a-415d-94cf-3479446a023c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:24.665070 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0e606a62-a55a-415d-94cf-3479446a023c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:24.668889 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0e606a62-a55a-415d-94cf-3479446a023c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 0.324421 Jul 25 12:15:24.669749 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 42/88] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:24 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:24.687715 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-73787218-b406-4e49-bb45-82341ce0db44 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:24.688658 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-73787218-b406-4e49-bb45-82341ce0db44 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:24.696851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73787218-b406-4e49-bb45-82341ce0db44 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:24.697443 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73787218-b406-4e49-bb45-82341ce0db44 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:24.698754 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73787218-b406-4e49-bb45-82341ce0db44 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:24.699269 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73787218-b406-4e49-bb45-82341ce0db44 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:24.801873 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-577db31d-eff5-4c7d-8833-b6ea26b8d5a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:24.810288 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-577db31d-eff5-4c7d-8833-b6ea26b8d5a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1367 microversion: 2.1 time: 0.635316 Jul 25 12:15:24.810979 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 47/89] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:24 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1367 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:24.901331 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-73787218-b406-4e49-bb45-82341ce0db44 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:24.909605 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-73787218-b406-4e49-bb45-82341ce0db44 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1363 microversion: 2.1 time: 0.238221 Jul 25 12:15:24.919987 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 43/90] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:24 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:25.086158 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-ec501a99-698a-418e-bd92-20662dd6adc2 req-ab4201c8-e990-41e9-bf9e-9219ac042cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d50aae7-fb06-467c-9a21-1d683297bc9e", "tag": "59a6c2e2-7638-469a-bca1-c81f367ece3f"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:25.098284 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-ec501a99-698a-418e-bd92-20662dd6adc2 req-ab4201c8-e990-41e9-bf9e-9219ac042cb5 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:25.098923 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-ec501a99-698a-418e-bd92-20662dd6adc2 req-ab4201c8-e990-41e9-bf9e-9219ac042cb5 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:25.147741 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-ec501a99-698a-418e-bd92-20662dd6adc2 req-ab4201c8-e990-41e9-bf9e-9219ac042cb5 service nova] Creating event network-changed:59a6c2e2-7638-469a-bca1-c81f367ece3f for instance 3d50aae7-fb06-467c-9a21-1d683297bc9e on hv-cinder-79760 Jul 25 12:15:25.169089 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-ec501a99-698a-418e-bd92-20662dd6adc2 req-ab4201c8-e990-41e9-bf9e-9219ac042cb5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083542 Jul 25 12:15:25.169089 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 48/91] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:15:25.196984 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-839e26c2-7548-4db0-9b8b-01c35deaad5e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:25.197897 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-839e26c2-7548-4db0-9b8b-01c35deaad5e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:25.206019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-839e26c2-7548-4db0-9b8b-01c35deaad5e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:25.208774 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-839e26c2-7548-4db0-9b8b-01c35deaad5e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:25.210451 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-839e26c2-7548-4db0-9b8b-01c35deaad5e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:25.212298 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-839e26c2-7548-4db0-9b8b-01c35deaad5e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:25.316076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-506ed4b9-8924-4157-964e-b3bb8de77153 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:25.316771 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-506ed4b9-8924-4157-964e-b3bb8de77153 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:25.327311 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-506ed4b9-8924-4157-964e-b3bb8de77153 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:25.327789 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-506ed4b9-8924-4157-964e-b3bb8de77153 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:25.328560 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-506ed4b9-8924-4157-964e-b3bb8de77153 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:25.328986 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-506ed4b9-8924-4157-964e-b3bb8de77153 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:25.688899 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-839e26c2-7548-4db0-9b8b-01c35deaad5e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:25.707968 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-839e26c2-7548-4db0-9b8b-01c35deaad5e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1322 microversion: 2.1 time: 0.516336 Jul 25 12:15:25.708924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 44/92] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:25 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:25.718587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3f5f50ca-5e5a-4430-b05f-07449b512e51 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:25.719889 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3f5f50ca-5e5a-4430-b05f-07449b512e51 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:25.734232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3f5f50ca-5e5a-4430-b05f-07449b512e51 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:25.739049 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3f5f50ca-5e5a-4430-b05f-07449b512e51 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:25.743033 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3f5f50ca-5e5a-4430-b05f-07449b512e51 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:25.744433 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3f5f50ca-5e5a-4430-b05f-07449b512e51 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:26.047095 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-506ed4b9-8924-4157-964e-b3bb8de77153 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:26.065639 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-506ed4b9-8924-4157-964e-b3bb8de77153 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1315 microversion: 2.1 time: 0.754954 Jul 25 12:15:26.086322 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 49/93] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:25 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:26.092991 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-53b799ca-9941-43dc-95e5-1f37c513b573 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:26.096803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-53b799ca-9941-43dc-95e5-1f37c513b573 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:26.104958 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3f5f50ca-5e5a-4430-b05f-07449b512e51 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:26.114457 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-53b799ca-9941-43dc-95e5-1f37c513b573 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:26.117229 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-53b799ca-9941-43dc-95e5-1f37c513b573 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:26.121325 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-53b799ca-9941-43dc-95e5-1f37c513b573 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:26.121936 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-53b799ca-9941-43dc-95e5-1f37c513b573 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:26.127179 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3f5f50ca-5e5a-4430-b05f-07449b512e51 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:26.128734 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3f5f50ca-5e5a-4430-b05f-07449b512e51 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:26.129865 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3f5f50ca-5e5a-4430-b05f-07449b512e51 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 0.419786 Jul 25 12:15:26.144900 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 45/94] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:25 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:26.151962 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7517eaa8-98e7-4b1b-86b4-a6cbe960b180 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:26.164610 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7517eaa8-98e7-4b1b-86b4-a6cbe960b180 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:26.171156 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7517eaa8-98e7-4b1b-86b4-a6cbe960b180 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:26.171832 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7517eaa8-98e7-4b1b-86b4-a6cbe960b180 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:26.172854 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7517eaa8-98e7-4b1b-86b4-a6cbe960b180 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:26.173438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7517eaa8-98e7-4b1b-86b4-a6cbe960b180 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:26.486109 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7517eaa8-98e7-4b1b-86b4-a6cbe960b180 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:26.497789 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7517eaa8-98e7-4b1b-86b4-a6cbe960b180 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1363 microversion: 2.1 time: 0.351585 Jul 25 12:15:26.502607 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 46/95] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:26 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:26.510790 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-53b799ca-9941-43dc-95e5-1f37c513b573 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:26.527582 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-53b799ca-9941-43dc-95e5-1f37c513b573 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1367 microversion: 2.1 time: 0.435436 Jul 25 12:15:26.529062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 50/96] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:26 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1367 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:26.731694 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a399d425-5fed-4e52-8ab9-372dfdc6ae0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:26.733964 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a399d425-5fed-4e52-8ab9-372dfdc6ae0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:26.746718 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a399d425-5fed-4e52-8ab9-372dfdc6ae0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:26.747339 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a399d425-5fed-4e52-8ab9-372dfdc6ae0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:26.749053 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a399d425-5fed-4e52-8ab9-372dfdc6ae0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:26.749749 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a399d425-5fed-4e52-8ab9-372dfdc6ae0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:26.906065 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a399d425-5fed-4e52-8ab9-372dfdc6ae0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:26.914119 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a399d425-5fed-4e52-8ab9-372dfdc6ae0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1322 microversion: 2.1 time: 0.187102 Jul 25 12:15:26.914698 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 47/97] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:26 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:27.093653 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9d2f28cc-7f0e-45a5-b20e-f92e3f32387c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:27.094269 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9d2f28cc-7f0e-45a5-b20e-f92e3f32387c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:27.101714 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:27.103269 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d2f28cc-7f0e-45a5-b20e-f92e3f32387c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:27.103771 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d2f28cc-7f0e-45a5-b20e-f92e3f32387c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:27.104521 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d2f28cc-7f0e-45a5-b20e-f92e3f32387c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:27.104955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d2f28cc-7f0e-45a5-b20e-f92e3f32387c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:27.168091 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2bdf511b-f638-482e-a3b1-70fe113eec91 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:27.170822 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2bdf511b-f638-482e-a3b1-70fe113eec91 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:27.204782 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2bdf511b-f638-482e-a3b1-70fe113eec91 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:27.205872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2bdf511b-f638-482e-a3b1-70fe113eec91 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:27.207140 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2bdf511b-f638-482e-a3b1-70fe113eec91 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:27.208280 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2bdf511b-f638-482e-a3b1-70fe113eec91 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:27.306557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9d2f28cc-7f0e-45a5-b20e-f92e3f32387c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:27.323377 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9d2f28cc-7f0e-45a5-b20e-f92e3f32387c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1315 microversion: 2.1 time: 0.233469 Jul 25 12:15:27.327578 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 51/98] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:27 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:27.404746 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2bdf511b-f638-482e-a3b1-70fe113eec91 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:27.415587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2bdf511b-f638-482e-a3b1-70fe113eec91 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:27.417109 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2bdf511b-f638-482e-a3b1-70fe113eec91 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:27.418370 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2bdf511b-f638-482e-a3b1-70fe113eec91 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 0.257205 Jul 25 12:15:27.419161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 48/99] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:27 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:27.523557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9a885b74-4c0f-4b82-9596-c68ae4eca257 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:27.525376 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9a885b74-4c0f-4b82-9596-c68ae4eca257 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:27.533667 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9a885b74-4c0f-4b82-9596-c68ae4eca257 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:27.536420 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9a885b74-4c0f-4b82-9596-c68ae4eca257 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:27.537374 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9a885b74-4c0f-4b82-9596-c68ae4eca257 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:27.538998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9a885b74-4c0f-4b82-9596-c68ae4eca257 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:27.554238 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-73336d32-6098-453b-945d-e09843455406 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:27.555340 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-73336d32-6098-453b-945d-e09843455406 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:27.562806 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73336d32-6098-453b-945d-e09843455406 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:27.563568 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73336d32-6098-453b-945d-e09843455406 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:27.564578 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73336d32-6098-453b-945d-e09843455406 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:27.565215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73336d32-6098-453b-945d-e09843455406 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:27.826702 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9a885b74-4c0f-4b82-9596-c68ae4eca257 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:27.834607 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-73336d32-6098-453b-945d-e09843455406 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:27.836663 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9a885b74-4c0f-4b82-9596-c68ae4eca257 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1363 microversion: 2.1 time: 0.318240 Jul 25 12:15:27.840739 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 52/100] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:27 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:27.856901 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-73336d32-6098-453b-945d-e09843455406 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1367 microversion: 2.1 time: 0.309363 Jul 25 12:15:27.859485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 49/101] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:27 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:27.934499 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cf43937d-3699-4517-8acf-1dc9b056af0f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:27.935299 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cf43937d-3699-4517-8acf-1dc9b056af0f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:27.950351 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf43937d-3699-4517-8acf-1dc9b056af0f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:27.950865 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf43937d-3699-4517-8acf-1dc9b056af0f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:27.951881 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf43937d-3699-4517-8acf-1dc9b056af0f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:27.952496 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf43937d-3699-4517-8acf-1dc9b056af0f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:28.234896 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cf43937d-3699-4517-8acf-1dc9b056af0f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:28.244552 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cf43937d-3699-4517-8acf-1dc9b056af0f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1322 microversion: 2.1 time: 0.314054 Jul 25 12:15:28.245131 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 53/102] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:27 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:28.346106 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-589d1e03-96cb-46d9-ad0d-a7c3cba743fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:28.347770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-589d1e03-96cb-46d9-ad0d-a7c3cba743fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:28.359279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-589d1e03-96cb-46d9-ad0d-a7c3cba743fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:28.359800 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-589d1e03-96cb-46d9-ad0d-a7c3cba743fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:28.360837 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-589d1e03-96cb-46d9-ad0d-a7c3cba743fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:28.361652 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-589d1e03-96cb-46d9-ad0d-a7c3cba743fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:28.454213 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7f220605-f918-41e8-83d5-16f47d4888e8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:28.454831 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7f220605-f918-41e8-83d5-16f47d4888e8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:28.466636 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f220605-f918-41e8-83d5-16f47d4888e8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:28.482938 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f220605-f918-41e8-83d5-16f47d4888e8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:28.485687 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f220605-f918-41e8-83d5-16f47d4888e8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:28.488754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7f220605-f918-41e8-83d5-16f47d4888e8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:28.709216 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-589d1e03-96cb-46d9-ad0d-a7c3cba743fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:28.721482 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-589d1e03-96cb-46d9-ad0d-a7c3cba743fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1315 microversion: 2.1 time: 0.380174 Jul 25 12:15:28.723266 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 50/103] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:28 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:28.828580 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7f220605-f918-41e8-83d5-16f47d4888e8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:28.838612 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7f220605-f918-41e8-83d5-16f47d4888e8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:28.840322 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7f220605-f918-41e8-83d5-16f47d4888e8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:28.841749 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7f220605-f918-41e8-83d5-16f47d4888e8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 0.399432 Jul 25 12:15:28.842414 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 54/104] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:28 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:15:28.860062 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c9da88f2-8b09-4967-856c-a57b6e7283a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:28.860721 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c9da88f2-8b09-4967-856c-a57b6e7283a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:28.871967 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9da88f2-8b09-4967-856c-a57b6e7283a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:28.873815 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9da88f2-8b09-4967-856c-a57b6e7283a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:28.874991 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9da88f2-8b09-4967-856c-a57b6e7283a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:28.876137 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9da88f2-8b09-4967-856c-a57b6e7283a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:28.879332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e768a98d-4d63-42aa-a8d2-0d174f0dd1c1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:28.880243 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e768a98d-4d63-42aa-a8d2-0d174f0dd1c1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:28.891276 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e768a98d-4d63-42aa-a8d2-0d174f0dd1c1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:28.894780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e768a98d-4d63-42aa-a8d2-0d174f0dd1c1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:28.895386 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e768a98d-4d63-42aa-a8d2-0d174f0dd1c1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:28.897190 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e768a98d-4d63-42aa-a8d2-0d174f0dd1c1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:29.150661 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e768a98d-4d63-42aa-a8d2-0d174f0dd1c1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:29.159999 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e768a98d-4d63-42aa-a8d2-0d174f0dd1c1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1367 microversion: 2.1 time: 0.285768 Jul 25 12:15:29.160540 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 55/105] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:28 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:29.205413 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c9da88f2-8b09-4967-856c-a57b6e7283a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:29.216622 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c9da88f2-8b09-4967-856c-a57b6e7283a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1363 microversion: 2.1 time: 0.360705 Jul 25 12:15:29.217527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 51/106] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:28 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1363 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:29.240279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-98c1bb78-1c03-4891-bc08-bc823a7f74e3 req-1054d5ae-6b3c-43b0-8efa-2dcfb95c654a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca94ee8-647e-426e-a219-a1bb3cf33deb", "name": "network-vif-plugged", "status": "completed", "tag": "7f197314-d0da-4b94-8f2d-39d9013c44e2"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:29.251090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-98c1bb78-1c03-4891-bc08-bc823a7f74e3 req-1054d5ae-6b3c-43b0-8efa-2dcfb95c654a service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:29.251994 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-98c1bb78-1c03-4891-bc08-bc823a7f74e3 req-1054d5ae-6b3c-43b0-8efa-2dcfb95c654a service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:29.263765 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-98c1bb78-1c03-4891-bc08-bc823a7f74e3 req-1054d5ae-6b3c-43b0-8efa-2dcfb95c654a service nova] Creating event network-vif-plugged:7f197314-d0da-4b94-8f2d-39d9013c44e2 for instance eca94ee8-647e-426e-a219-a1bb3cf33deb on hv-cinder-79760 Jul 25 12:15:29.266363 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-752fa45f-2477-4662-8e81-39f78adf71f4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:29.268463 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-752fa45f-2477-4662-8e81-39f78adf71f4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:29.269195 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-98c1bb78-1c03-4891-bc08-bc823a7f74e3 req-1054d5ae-6b3c-43b0-8efa-2dcfb95c654a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107474 Jul 25 12:15:29.270235 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 56/107] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:15:29.276205 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-752fa45f-2477-4662-8e81-39f78adf71f4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:29.276791 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-752fa45f-2477-4662-8e81-39f78adf71f4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:29.277980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-752fa45f-2477-4662-8e81-39f78adf71f4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:29.278656 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-752fa45f-2477-4662-8e81-39f78adf71f4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:29.567244 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-752fa45f-2477-4662-8e81-39f78adf71f4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:29.571217 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:29.575801 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-752fa45f-2477-4662-8e81-39f78adf71f4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1322 microversion: 2.1 time: 0.314000 Jul 25 12:15:29.591352 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 52/108] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:29 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:29.744961 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-05533423-b4a2-429c-ad40-6e9afe497e34 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:29.746486 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-05533423-b4a2-429c-ad40-6e9afe497e34 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:29.758056 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05533423-b4a2-429c-ad40-6e9afe497e34 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:29.758877 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05533423-b4a2-429c-ad40-6e9afe497e34 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:29.759917 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05533423-b4a2-429c-ad40-6e9afe497e34 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:29.760532 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05533423-b4a2-429c-ad40-6e9afe497e34 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:29.869273 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-904cabc1-8d44-4432-95ac-ba2ff0325216 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:29.869895 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-904cabc1-8d44-4432-95ac-ba2ff0325216 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:29.876968 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-904cabc1-8d44-4432-95ac-ba2ff0325216 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:29.877411 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-904cabc1-8d44-4432-95ac-ba2ff0325216 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:29.878408 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-904cabc1-8d44-4432-95ac-ba2ff0325216 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:29.879174 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-904cabc1-8d44-4432-95ac-ba2ff0325216 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:29.952258 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=10 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:30.016070 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-05533423-b4a2-429c-ad40-6e9afe497e34 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:30.025139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-05533423-b4a2-429c-ad40-6e9afe497e34 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1315 microversion: 2.1 time: 0.284730 Jul 25 12:15:30.025998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 57/109] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:29 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:30.137037 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-904cabc1-8d44-4432-95ac-ba2ff0325216 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:30.150162 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-904cabc1-8d44-4432-95ac-ba2ff0325216 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:30.152085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-904cabc1-8d44-4432-95ac-ba2ff0325216 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:30.153443 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-904cabc1-8d44-4432-95ac-ba2ff0325216 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 0.291946 Jul 25 12:15:30.156768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 53/110] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:29 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:15:30.183444 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6c6b34aa-312c-4ee1-800d-99fff41ac175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:30.184914 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6c6b34aa-312c-4ee1-800d-99fff41ac175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:30.200296 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c6b34aa-312c-4ee1-800d-99fff41ac175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:30.200740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c6b34aa-312c-4ee1-800d-99fff41ac175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:30.201569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c6b34aa-312c-4ee1-800d-99fff41ac175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:30.203720 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6c6b34aa-312c-4ee1-800d-99fff41ac175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:30.239532 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-97b3f127-07fa-47df-b09e-64568dd8787f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:30.240765 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-97b3f127-07fa-47df-b09e-64568dd8787f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:30.264960 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-97b3f127-07fa-47df-b09e-64568dd8787f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:30.266997 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-97b3f127-07fa-47df-b09e-64568dd8787f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:30.270329 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-97b3f127-07fa-47df-b09e-64568dd8787f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:30.271717 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-97b3f127-07fa-47df-b09e-64568dd8787f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:30.425466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6c6b34aa-312c-4ee1-800d-99fff41ac175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:30.441144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:30.455793 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6c6b34aa-312c-4ee1-800d-99fff41ac175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1367 microversion: 2.1 time: 0.276604 Jul 25 12:15:30.456556 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 58/111] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:30 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:30.601836 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-97b3f127-07fa-47df-b09e-64568dd8787f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:30.608019 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1d2c07cd-ab17-4396-b280-244b3f976630 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:30.610223 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1d2c07cd-ab17-4396-b280-244b3f976630 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:30.630477 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-97b3f127-07fa-47df-b09e-64568dd8787f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1363 microversion: 2.1 time: 0.395930 Jul 25 12:15:30.639879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 54/112] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:30 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1363 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:30.642156 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1d2c07cd-ab17-4396-b280-244b3f976630 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:30.644520 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1d2c07cd-ab17-4396-b280-244b3f976630 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:30.645489 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1d2c07cd-ab17-4396-b280-244b3f976630 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:30.646479 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1d2c07cd-ab17-4396-b280-244b3f976630 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:30.900349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1d2c07cd-ab17-4396-b280-244b3f976630 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:30.911971 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1d2c07cd-ab17-4396-b280-244b3f976630 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1322 microversion: 2.1 time: 0.317723 Jul 25 12:15:30.928918 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 59/113] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:30 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:31.060836 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2f7c5806-845b-4769-8918-3c443cf6527c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:31.064451 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2f7c5806-845b-4769-8918-3c443cf6527c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:31.073016 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f7c5806-845b-4769-8918-3c443cf6527c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:31.074819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f7c5806-845b-4769-8918-3c443cf6527c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:31.076042 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f7c5806-845b-4769-8918-3c443cf6527c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:31.076616 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f7c5806-845b-4769-8918-3c443cf6527c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:31.187269 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-43c5ad76-6cf5-448f-aedc-c0419c084b0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:31.188305 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-43c5ad76-6cf5-448f-aedc-c0419c084b0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:31.200933 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43c5ad76-6cf5-448f-aedc-c0419c084b0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:31.201978 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43c5ad76-6cf5-448f-aedc-c0419c084b0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:31.203969 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43c5ad76-6cf5-448f-aedc-c0419c084b0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:31.207157 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43c5ad76-6cf5-448f-aedc-c0419c084b0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:31.233260 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2f7c5806-845b-4769-8918-3c443cf6527c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:31.242511 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2f7c5806-845b-4769-8918-3c443cf6527c tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1315 microversion: 2.1 time: 0.199212 Jul 25 12:15:31.244502 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 55/114] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:31 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:31.290238 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-b2d0d6fc-9904-4284-b6a9-3e7284691a25 req-8633d72b-d1e1-4c32-aa95-ff44054feaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ec6126-ab67-4094-ade6-816f0e39ba46", "name": "network-vif-plugged", "status": "completed", "tag": "3b24bc1b-53c9-4417-92af-4eb343429851"}, {"server_uuid": "c9644e94-ac1d-497c-868e-36945ba75fa6", "name": "network-vif-plugged", "status": "completed", "tag": "c8918714-06f3-4c5f-bc49-913ec7c6960a"}, {"server_uuid": "66654721-31e2-48d8-a0ea-c146d277ab47", "name": "network-vif-plugged", "status": "completed", "tag": "d01f3ff0-df08-4605-a057-7920ee080060"}, {"server_uuid": "8ea750ca-a1eb-4a15-ad78-dddfc62d8d13", "name": "network-vif-plugged", "status": "completed", "tag": "f2fd4c6c-baa4-4900-8f20-a81e46e1b234"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:31.303981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-b2d0d6fc-9904-4284-b6a9-3e7284691a25 req-8633d72b-d1e1-4c32-aa95-ff44054feaf7 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:31.304614 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-b2d0d6fc-9904-4284-b6a9-3e7284691a25 req-8633d72b-d1e1-4c32-aa95-ff44054feaf7 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:31.333910 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-b2d0d6fc-9904-4284-b6a9-3e7284691a25 req-8633d72b-d1e1-4c32-aa95-ff44054feaf7 service nova] Creating event network-vif-plugged:3b24bc1b-53c9-4417-92af-4eb343429851 for instance 03ec6126-ab67-4094-ade6-816f0e39ba46 on hv-cinder-79760 Jul 25 12:15:31.334641 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-b2d0d6fc-9904-4284-b6a9-3e7284691a25 req-8633d72b-d1e1-4c32-aa95-ff44054feaf7 service nova] Creating event network-vif-plugged:c8918714-06f3-4c5f-bc49-913ec7c6960a for instance c9644e94-ac1d-497c-868e-36945ba75fa6 on hv-cinder-79760 Jul 25 12:15:31.335357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-b2d0d6fc-9904-4284-b6a9-3e7284691a25 req-8633d72b-d1e1-4c32-aa95-ff44054feaf7 service nova] Creating event network-vif-plugged:d01f3ff0-df08-4605-a057-7920ee080060 for instance 66654721-31e2-48d8-a0ea-c146d277ab47 on hv-cinder-79760 Jul 25 12:15:31.336111 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-b2d0d6fc-9904-4284-b6a9-3e7284691a25 req-8633d72b-d1e1-4c32-aa95-ff44054feaf7 service nova] Creating event network-vif-plugged:f2fd4c6c-baa4-4900-8f20-a81e46e1b234 for instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 on hv-cinder-79760 Jul 25 12:15:31.351174 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-b2d0d6fc-9904-4284-b6a9-3e7284691a25 req-8633d72b-d1e1-4c32-aa95-ff44054feaf7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.063187 Jul 25 12:15:31.353001 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 56/115] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:15:31.397889 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-43c5ad76-6cf5-448f-aedc-c0419c084b0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:31.411980 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-43c5ad76-6cf5-448f-aedc-c0419c084b0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:31.419235 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-43c5ad76-6cf5-448f-aedc-c0419c084b0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:31.421777 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-43c5ad76-6cf5-448f-aedc-c0419c084b0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 0.239343 Jul 25 12:15:31.422690 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 60/116] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:31 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:31.477230 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cce3a301-4866-4dde-bb0c-80b6dba8bf38 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:31.478075 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cce3a301-4866-4dde-bb0c-80b6dba8bf38 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:31.488396 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cce3a301-4866-4dde-bb0c-80b6dba8bf38 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:31.490014 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cce3a301-4866-4dde-bb0c-80b6dba8bf38 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:31.490815 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cce3a301-4866-4dde-bb0c-80b6dba8bf38 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:31.493035 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cce3a301-4866-4dde-bb0c-80b6dba8bf38 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:31.662611 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-482eb757-feb5-47f6-90bd-ed1bbd8155a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:31.664199 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-482eb757-feb5-47f6-90bd-ed1bbd8155a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:31.674791 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-482eb757-feb5-47f6-90bd-ed1bbd8155a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:31.676370 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-482eb757-feb5-47f6-90bd-ed1bbd8155a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:31.678573 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-482eb757-feb5-47f6-90bd-ed1bbd8155a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:31.680649 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-482eb757-feb5-47f6-90bd-ed1bbd8155a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:31.879755 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cce3a301-4866-4dde-bb0c-80b6dba8bf38 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:31.888184 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cce3a301-4866-4dde-bb0c-80b6dba8bf38 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1367 microversion: 2.1 time: 0.415195 Jul 25 12:15:31.890938 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 57/117] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:31 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1367 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:31.934466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9fea8001-cdef-4c76-9459-64219ccbf181 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:31.935780 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9fea8001-cdef-4c76-9459-64219ccbf181 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:31.943799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9fea8001-cdef-4c76-9459-64219ccbf181 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:31.944854 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9fea8001-cdef-4c76-9459-64219ccbf181 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:31.946709 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9fea8001-cdef-4c76-9459-64219ccbf181 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:31.947313 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9fea8001-cdef-4c76-9459-64219ccbf181 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:32.046103 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-482eb757-feb5-47f6-90bd-ed1bbd8155a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:32.056394 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-482eb757-feb5-47f6-90bd-ed1bbd8155a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1363 microversion: 2.1 time: 0.397874 Jul 25 12:15:32.068192 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 61/118] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:31 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1363 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:32.158670 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9fea8001-cdef-4c76-9459-64219ccbf181 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:32.166918 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9fea8001-cdef-4c76-9459-64219ccbf181 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1516 microversion: 2.1 time: 0.236336 Jul 25 12:15:32.167740 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 58/119] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:31 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1516 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:32.189235 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-92eb4059-af07-4180-a628-bd578c88fc46 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:32.192363 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-92eb4059-af07-4180-a628-bd578c88fc46 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:32.200543 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92eb4059-af07-4180-a628-bd578c88fc46 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:32.201571 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92eb4059-af07-4180-a628-bd578c88fc46 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:32.202590 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92eb4059-af07-4180-a628-bd578c88fc46 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:32.203220 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92eb4059-af07-4180-a628-bd578c88fc46 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:32.266743 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ad455467-ce3d-4be8-b5ab-804723628293 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:32.267357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ad455467-ce3d-4be8-b5ab-804723628293 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:32.283361 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-92eb4059-af07-4180-a628-bd578c88fc46 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lazy-loading 'flavor' on Instance uuid eca94ee8-647e-426e-a219-a1bb3cf33deb {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:15:32.286082 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad455467-ce3d-4be8-b5ab-804723628293 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:32.286507 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad455467-ce3d-4be8-b5ab-804723628293 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:32.287332 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad455467-ce3d-4be8-b5ab-804723628293 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:32.287821 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ad455467-ce3d-4be8-b5ab-804723628293 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:32.500317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-92eb4059-af07-4180-a628-bd578c88fc46 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "POST /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb/action" status: 200 len: 32 microversion: 2.1 time: 0.315237 Jul 25 12:15:32.505812 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 62/120] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:15:32 2022] POST /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb/action => generated 32 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:15:32.511730 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-93bcbae3-955b-4cf6-9979-482cdaaa3395 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:32.512604 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-93bcbae3-955b-4cf6-9979-482cdaaa3395 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:32.521099 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93bcbae3-955b-4cf6-9979-482cdaaa3395 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:32.526366 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93bcbae3-955b-4cf6-9979-482cdaaa3395 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:32.527448 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93bcbae3-955b-4cf6-9979-482cdaaa3395 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:32.528043 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93bcbae3-955b-4cf6-9979-482cdaaa3395 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:32.584186 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ad455467-ce3d-4be8-b5ab-804723628293 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:32.594360 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ad455467-ce3d-4be8-b5ab-804723628293 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1315 microversion: 2.1 time: 0.331276 Jul 25 12:15:32.596042 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 59/121] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:32 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:32.615760 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2f3500e5-3513-4d16-9aff-c7951266b0ee tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:32.617372 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2f3500e5-3513-4d16-9aff-c7951266b0ee tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:32.624813 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f3500e5-3513-4d16-9aff-c7951266b0ee tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:32.625608 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f3500e5-3513-4d16-9aff-c7951266b0ee tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:32.626744 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f3500e5-3513-4d16-9aff-c7951266b0ee tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:32.627797 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f3500e5-3513-4d16-9aff-c7951266b0ee tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:32.733473 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-93bcbae3-955b-4cf6-9979-482cdaaa3395 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:32.744875 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-93bcbae3-955b-4cf6-9979-482cdaaa3395 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:32.746834 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-93bcbae3-955b-4cf6-9979-482cdaaa3395 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:32.748330 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-93bcbae3-955b-4cf6-9979-482cdaaa3395 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 0.241160 Jul 25 12:15:32.749096 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 63/122] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:32 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:32.809083 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2f3500e5-3513-4d16-9aff-c7951266b0ee tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:32.820946 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2f3500e5-3513-4d16-9aff-c7951266b0ee tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.223594 Jul 25 12:15:32.824103 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 60/123] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:32 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:32.912055 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-68d2229a-61ec-4680-a91e-e1f98df4226d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:32.912667 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-68d2229a-61ec-4680-a91e-e1f98df4226d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:32.919229 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68d2229a-61ec-4680-a91e-e1f98df4226d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:32.919808 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68d2229a-61ec-4680-a91e-e1f98df4226d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:32.920679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68d2229a-61ec-4680-a91e-e1f98df4226d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:32.921118 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68d2229a-61ec-4680-a91e-e1f98df4226d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:33.077814 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a3c1d62b-6724-4512-b26a-070a12d007e9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:33.078832 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a3c1d62b-6724-4512-b26a-070a12d007e9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:33.086871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a3c1d62b-6724-4512-b26a-070a12d007e9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:33.087920 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a3c1d62b-6724-4512-b26a-070a12d007e9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:33.088986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a3c1d62b-6724-4512-b26a-070a12d007e9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:33.089693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a3c1d62b-6724-4512-b26a-070a12d007e9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:33.113513 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-68d2229a-61ec-4680-a91e-e1f98df4226d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:33.124483 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-68d2229a-61ec-4680-a91e-e1f98df4226d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1367 microversion: 2.1 time: 0.215948 Jul 25 12:15:33.125729 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 64/124] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:32 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:33.276808 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a3c1d62b-6724-4512-b26a-070a12d007e9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:33.285841 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a3c1d62b-6724-4512-b26a-070a12d007e9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1363 microversion: 2.1 time: 0.211936 Jul 25 12:15:33.286691 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 61/125] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:33 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:33.371774 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-f7acf497-130e-4ff5-ab03-cd57cac6d14c req-5bb6138c-d84a-4d9d-b420-702e8419de08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d50aae7-fb06-467c-9a21-1d683297bc9e", "name": "network-vif-plugged", "status": "completed", "tag": "59a6c2e2-7638-469a-bca1-c81f367ece3f"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:33.387039 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-f7acf497-130e-4ff5-ab03-cd57cac6d14c req-5bb6138c-d84a-4d9d-b420-702e8419de08 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:33.387967 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-f7acf497-130e-4ff5-ab03-cd57cac6d14c req-5bb6138c-d84a-4d9d-b420-702e8419de08 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:33.421631 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-f7acf497-130e-4ff5-ab03-cd57cac6d14c req-5bb6138c-d84a-4d9d-b420-702e8419de08 service nova] Creating event network-vif-plugged:59a6c2e2-7638-469a-bca1-c81f367ece3f for instance 3d50aae7-fb06-467c-9a21-1d683297bc9e on hv-cinder-79760 Jul 25 12:15:33.429001 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-f7acf497-130e-4ff5-ab03-cd57cac6d14c req-5bb6138c-d84a-4d9d-b420-702e8419de08 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061825 Jul 25 12:15:33.430025 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 65/126] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:15:33.620589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e579f47b-07f4-4ace-8951-4cc7ffe690fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:33.621756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e579f47b-07f4-4ace-8951-4cc7ffe690fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:33.628362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e579f47b-07f4-4ace-8951-4cc7ffe690fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:33.635257 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e579f47b-07f4-4ace-8951-4cc7ffe690fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:33.636785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e579f47b-07f4-4ace-8951-4cc7ffe690fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:33.637697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e579f47b-07f4-4ace-8951-4cc7ffe690fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:33.774669 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-695da039-be0a-4658-94a4-d3f4df2fef48 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:33.776337 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-695da039-be0a-4658-94a4-d3f4df2fef48 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:33.787092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-695da039-be0a-4658-94a4-d3f4df2fef48 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:33.787693 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-695da039-be0a-4658-94a4-d3f4df2fef48 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:33.789022 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-695da039-be0a-4658-94a4-d3f4df2fef48 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:33.789578 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-695da039-be0a-4658-94a4-d3f4df2fef48 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:33.853102 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e579f47b-07f4-4ace-8951-4cc7ffe690fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:33.863007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e579f47b-07f4-4ace-8951-4cc7ffe690fe tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1315 microversion: 2.1 time: 0.246623 Jul 25 12:15:33.865343 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 62/127] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:33 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:33.885694 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-48c47ca0-34be-4d6e-9d2b-f24668166d4c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:33.886725 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-48c47ca0-34be-4d6e-9d2b-f24668166d4c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:33.892112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:33.894559 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48c47ca0-34be-4d6e-9d2b-f24668166d4c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:33.895094 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48c47ca0-34be-4d6e-9d2b-f24668166d4c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:33.895897 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48c47ca0-34be-4d6e-9d2b-f24668166d4c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:33.896717 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48c47ca0-34be-4d6e-9d2b-f24668166d4c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:33.998061 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-695da039-be0a-4658-94a4-d3f4df2fef48 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:34.007208 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-695da039-be0a-4658-94a4-d3f4df2fef48 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:34.008820 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-695da039-be0a-4658-94a4-d3f4df2fef48 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:34.010102 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-695da039-be0a-4658-94a4-d3f4df2fef48 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1406 microversion: 2.20 time: 0.241654 Jul 25 12:15:34.011138 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 66/128] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:33 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:15:34.081561 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-48c47ca0-34be-4d6e-9d2b-f24668166d4c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:34.091528 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-48c47ca0-34be-4d6e-9d2b-f24668166d4c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.209798 Jul 25 12:15:34.092122 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 63/129] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:33 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:34.146332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-951bbf6c-1052-4224-8338-92f544c1fd04 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:34.147435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-951bbf6c-1052-4224-8338-92f544c1fd04 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:34.153810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-951bbf6c-1052-4224-8338-92f544c1fd04 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:34.154243 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-951bbf6c-1052-4224-8338-92f544c1fd04 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:34.155014 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-951bbf6c-1052-4224-8338-92f544c1fd04 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:34.155450 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-951bbf6c-1052-4224-8338-92f544c1fd04 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:34.311902 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7129bcbb-0f38-4c44-8709-75cb98fbba35 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:34.313306 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7129bcbb-0f38-4c44-8709-75cb98fbba35 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:34.317223 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-951bbf6c-1052-4224-8338-92f544c1fd04 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:34.321659 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7129bcbb-0f38-4c44-8709-75cb98fbba35 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:34.322266 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7129bcbb-0f38-4c44-8709-75cb98fbba35 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:34.323502 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7129bcbb-0f38-4c44-8709-75cb98fbba35 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:34.324158 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7129bcbb-0f38-4c44-8709-75cb98fbba35 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:34.326009 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-951bbf6c-1052-4224-8338-92f544c1fd04 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1367 microversion: 2.1 time: 0.183440 Jul 25 12:15:34.337047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 67/130] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:34 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:34.512893 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7129bcbb-0f38-4c44-8709-75cb98fbba35 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:34.523092 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7129bcbb-0f38-4c44-8709-75cb98fbba35 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1363 microversion: 2.1 time: 0.220443 Jul 25 12:15:34.524098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 64/131] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:34 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:34.888519 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-99a3e5ab-a75f-4b33-8507-26e817b092ce tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:34.890318 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-99a3e5ab-a75f-4b33-8507-26e817b092ce tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:34.899189 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99a3e5ab-a75f-4b33-8507-26e817b092ce tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:34.900892 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99a3e5ab-a75f-4b33-8507-26e817b092ce tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:34.904626 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99a3e5ab-a75f-4b33-8507-26e817b092ce tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:34.905289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-99a3e5ab-a75f-4b33-8507-26e817b092ce tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:35.033882 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-627856f6-2d04-4fc2-b887-efde7e5b84c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:35.035177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-627856f6-2d04-4fc2-b887-efde7e5b84c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:35.042478 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-627856f6-2d04-4fc2-b887-efde7e5b84c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:35.042821 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-627856f6-2d04-4fc2-b887-efde7e5b84c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:35.043926 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-627856f6-2d04-4fc2-b887-efde7e5b84c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:35.045097 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-627856f6-2d04-4fc2-b887-efde7e5b84c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:35.115230 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-99a3e5ab-a75f-4b33-8507-26e817b092ce tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:35.124828 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-99a3e5ab-a75f-4b33-8507-26e817b092ce tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1502 microversion: 2.1 time: 0.241221 Jul 25 12:15:35.125972 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 68/132] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:34 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1502 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:35.132399 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-af86c20e-cc93-4014-85ed-7e4d99cb6138 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:35.133309 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-af86c20e-cc93-4014-85ed-7e4d99cb6138 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:35.141838 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af86c20e-cc93-4014-85ed-7e4d99cb6138 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:35.142563 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af86c20e-cc93-4014-85ed-7e4d99cb6138 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:35.143564 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af86c20e-cc93-4014-85ed-7e4d99cb6138 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:35.144195 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af86c20e-cc93-4014-85ed-7e4d99cb6138 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:35.242345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-627856f6-2d04-4fc2-b887-efde7e5b84c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:35.251376 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-627856f6-2d04-4fc2-b887-efde7e5b84c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:35.253199 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-627856f6-2d04-4fc2-b887-efde7e5b84c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:35.254478 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-627856f6-2d04-4fc2-b887-efde7e5b84c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1598 microversion: 2.20 time: 0.224967 Jul 25 12:15:35.255037 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 65/133] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:15:35 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1598 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:15:35.280845 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5504498a-c181-4157-a555-e5d07f741548 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:35.282012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5504498a-c181-4157-a555-e5d07f741548 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:35.289059 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5504498a-c181-4157-a555-e5d07f741548 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:35.289583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5504498a-c181-4157-a555-e5d07f741548 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:35.290422 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5504498a-c181-4157-a555-e5d07f741548 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:35.290924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5504498a-c181-4157-a555-e5d07f741548 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:35.333361 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-af86c20e-cc93-4014-85ed-7e4d99cb6138 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:35.341361 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-af86c20e-cc93-4014-85ed-7e4d99cb6138 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.213809 Jul 25 12:15:35.342218 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 69/134] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:35 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:35.352600 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3183e746-5b2f-4f93-b5f7-a2fe6c7f5d6a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:35.356366 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3183e746-5b2f-4f93-b5f7-a2fe6c7f5d6a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:35.366710 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3183e746-5b2f-4f93-b5f7-a2fe6c7f5d6a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:35.367746 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3183e746-5b2f-4f93-b5f7-a2fe6c7f5d6a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:35.368831 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3183e746-5b2f-4f93-b5f7-a2fe6c7f5d6a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:35.369445 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3183e746-5b2f-4f93-b5f7-a2fe6c7f5d6a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:35.708197 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3183e746-5b2f-4f93-b5f7-a2fe6c7f5d6a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:35.717110 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3183e746-5b2f-4f93-b5f7-a2fe6c7f5d6a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1367 microversion: 2.1 time: 0.372848 Jul 25 12:15:35.718005 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 70/135] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:35 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:35.722959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c37b6b70-6ccb-4bc5-ba50-79a3b31afebe tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:35.723630 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c37b6b70-6ccb-4bc5-ba50-79a3b31afebe tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:35.730250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c37b6b70-6ccb-4bc5-ba50-79a3b31afebe tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:35.730714 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c37b6b70-6ccb-4bc5-ba50-79a3b31afebe tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:35.731517 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c37b6b70-6ccb-4bc5-ba50-79a3b31afebe tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:35.731942 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c37b6b70-6ccb-4bc5-ba50-79a3b31afebe tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:35.768085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5504498a-c181-4157-a555-e5d07f741548 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.490587 Jul 25 12:15:35.769314 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 66/136] 10.222.0.42 () {60 vars in 1316 bytes} [Mon Jul 25 12:15:35 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-interface => generated 285 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:15:36.140901 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c37b6b70-6ccb-4bc5-ba50-79a3b31afebe tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:36.149593 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c37b6b70-6ccb-4bc5-ba50-79a3b31afebe tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1548 microversion: 2.1 time: 0.430299 Jul 25 12:15:36.153871 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 71/137] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:35 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1548 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:36.177998 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f851cbc3-887d-49ba-8d76-1e3dcdd9c877 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:36.178561 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f851cbc3-887d-49ba-8d76-1e3dcdd9c877 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:36.187998 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f851cbc3-887d-49ba-8d76-1e3dcdd9c877 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:36.188449 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f851cbc3-887d-49ba-8d76-1e3dcdd9c877 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:36.189219 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f851cbc3-887d-49ba-8d76-1e3dcdd9c877 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:36.189640 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f851cbc3-887d-49ba-8d76-1e3dcdd9c877 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:36.331907 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f851cbc3-887d-49ba-8d76-1e3dcdd9c877 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157674 Jul 25 12:15:36.332712 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 67/138] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Jul 25 12:15:36 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:15:36.363180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a1d89697-637d-4365-8cd7-33f96a040397 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:36.364464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a1d89697-637d-4365-8cd7-33f96a040397 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:36.371077 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a1d89697-637d-4365-8cd7-33f96a040397 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:36.371979 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a1d89697-637d-4365-8cd7-33f96a040397 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:36.372904 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a1d89697-637d-4365-8cd7-33f96a040397 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:36.373935 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a1d89697-637d-4365-8cd7-33f96a040397 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:36.738134 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b2d7189a-b652-40a4-b85e-3cca64bfa996 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:36.738960 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b2d7189a-b652-40a4-b85e-3cca64bfa996 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:36.752861 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2d7189a-b652-40a4-b85e-3cca64bfa996 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:36.753568 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2d7189a-b652-40a4-b85e-3cca64bfa996 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:36.754530 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2d7189a-b652-40a4-b85e-3cca64bfa996 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:36.755143 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b2d7189a-b652-40a4-b85e-3cca64bfa996 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:36.934829 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a1d89697-637d-4365-8cd7-33f96a040397 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:36.942623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a1d89697-637d-4365-8cd7-33f96a040397 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.583846 Jul 25 12:15:36.943201 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 72/139] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:36 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:36.952937 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-15adf5a1-ac62-44a9-8c7c-7a7e6e8a9ca9 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e079c32d-2186-4f4c-a78f-fbc594c1a894"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:36.960995 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-15adf5a1-ac62-44a9-8c7c-7a7e6e8a9ca9 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:36.985857 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15adf5a1-ac62-44a9-8c7c-7a7e6e8a9ca9 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:36.986387 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15adf5a1-ac62-44a9-8c7c-7a7e6e8a9ca9 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:36.987224 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15adf5a1-ac62-44a9-8c7c-7a7e6e8a9ca9 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:36.988816 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15adf5a1-ac62-44a9-8c7c-7a7e6e8a9ca9 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:37.250057 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:37.429544 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b2d7189a-b652-40a4-b85e-3cca64bfa996 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:37.437176 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b2d7189a-b652-40a4-b85e-3cca64bfa996 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1367 microversion: 2.1 time: 0.702779 Jul 25 12:15:37.453109 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 68/140] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:36 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1367 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:37.480841 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-15adf5a1-ac62-44a9-8c7c-7a7e6e8a9ca9 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "POST /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535726 Jul 25 12:15:37.483464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 73/141] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:15:36 2022] POST /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:15:37.969689 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9ded76ae-3633-41fc-af92-48fb61169801 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:37.970306 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9ded76ae-3633-41fc-af92-48fb61169801 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:37.976679 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ded76ae-3633-41fc-af92-48fb61169801 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:37.977134 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ded76ae-3633-41fc-af92-48fb61169801 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:37.977895 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ded76ae-3633-41fc-af92-48fb61169801 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:37.978320 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ded76ae-3633-41fc-af92-48fb61169801 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:38.093078 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-b0611cf2-b1e4-43fa-9f40-63d89eb5d9fb req-35c8e43c-7cbc-45b7-ab9d-f2a6180703d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66654721-31e2-48d8-a0ea-c146d277ab47", "tag": "d01f3ff0-df08-4605-a057-7920ee080060"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:38.105554 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b0611cf2-b1e4-43fa-9f40-63d89eb5d9fb req-35c8e43c-7cbc-45b7-ab9d-f2a6180703d7 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:38.106205 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b0611cf2-b1e4-43fa-9f40-63d89eb5d9fb req-35c8e43c-7cbc-45b7-ab9d-f2a6180703d7 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:38.119667 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-b0611cf2-b1e4-43fa-9f40-63d89eb5d9fb req-35c8e43c-7cbc-45b7-ab9d-f2a6180703d7 service nova] Creating event network-changed:d01f3ff0-df08-4605-a057-7920ee080060 for instance 66654721-31e2-48d8-a0ea-c146d277ab47 on hv-cinder-79760 Jul 25 12:15:38.125392 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-b0611cf2-b1e4-43fa-9f40-63d89eb5d9fb req-35c8e43c-7cbc-45b7-ab9d-f2a6180703d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036854 Jul 25 12:15:38.130029 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 74/142] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:15:38.208996 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9ded76ae-3633-41fc-af92-48fb61169801 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:38.213994 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-ecf8470b-3905-42a5-9706-752a0a4e2911 req-9b57cd01-1a3d-479d-9362-351aa8d537dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea750ca-a1eb-4a15-ad78-dddfc62d8d13", "tag": "f2fd4c6c-baa4-4900-8f20-a81e46e1b234"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:38.216924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9ded76ae-3633-41fc-af92-48fb61169801 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.254149 Jul 25 12:15:38.232435 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 69/143] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:37 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:38.239618 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-ecf8470b-3905-42a5-9706-752a0a4e2911 req-9b57cd01-1a3d-479d-9362-351aa8d537dd service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:38.240099 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-ecf8470b-3905-42a5-9706-752a0a4e2911 req-9b57cd01-1a3d-479d-9362-351aa8d537dd service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:38.269632 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-ecf8470b-3905-42a5-9706-752a0a4e2911 req-9b57cd01-1a3d-479d-9362-351aa8d537dd service nova] Creating event network-changed:f2fd4c6c-baa4-4900-8f20-a81e46e1b234 for instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 on hv-cinder-79760 Jul 25 12:15:38.277993 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-ecf8470b-3905-42a5-9706-752a0a4e2911 req-9b57cd01-1a3d-479d-9362-351aa8d537dd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069279 Jul 25 12:15:38.280664 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 75/144] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:15:38.463821 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3299dd66-e38d-4f98-a7b2-a0f5679e91b7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:38.464233 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3299dd66-e38d-4f98-a7b2-a0f5679e91b7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:38.476104 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3299dd66-e38d-4f98-a7b2-a0f5679e91b7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:38.476564 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3299dd66-e38d-4f98-a7b2-a0f5679e91b7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:38.479913 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3299dd66-e38d-4f98-a7b2-a0f5679e91b7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:38.480817 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3299dd66-e38d-4f98-a7b2-a0f5679e91b7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:38.997948 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3299dd66-e38d-4f98-a7b2-a0f5679e91b7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:39.002675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:39.012356 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3299dd66-e38d-4f98-a7b2-a0f5679e91b7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1367 microversion: 2.1 time: 0.552778 Jul 25 12:15:39.013483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 70/145] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:38 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1367 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:39.245621 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-824ba3ce-57e2-4b72-a0fd-ade92dff827e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:39.246616 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-824ba3ce-57e2-4b72-a0fd-ade92dff827e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:39.253211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-824ba3ce-57e2-4b72-a0fd-ade92dff827e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:39.253545 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-824ba3ce-57e2-4b72-a0fd-ade92dff827e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:39.254313 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-824ba3ce-57e2-4b72-a0fd-ade92dff827e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:39.254740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-824ba3ce-57e2-4b72-a0fd-ade92dff827e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:39.413905 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-824ba3ce-57e2-4b72-a0fd-ade92dff827e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:39.422041 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-824ba3ce-57e2-4b72-a0fd-ade92dff827e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.184846 Jul 25 12:15:39.435512 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 76/146] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:39 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:40.034039 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f158c4ee-01e0-4822-a4f5-2289f82f8919 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:40.035939 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f158c4ee-01e0-4822-a4f5-2289f82f8919 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:40.049132 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f158c4ee-01e0-4822-a4f5-2289f82f8919 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:40.052641 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f158c4ee-01e0-4822-a4f5-2289f82f8919 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:40.056441 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f158c4ee-01e0-4822-a4f5-2289f82f8919 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:40.057359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f158c4ee-01e0-4822-a4f5-2289f82f8919 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:40.302628 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f158c4ee-01e0-4822-a4f5-2289f82f8919 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:40.312718 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f158c4ee-01e0-4822-a4f5-2289f82f8919 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1558 microversion: 2.1 time: 0.283191 Jul 25 12:15:40.313665 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 71/147] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:40 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1558 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:40.333879 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1a9e124d-03be-483d-b058-9a390c72a7e0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:40.334992 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1a9e124d-03be-483d-b058-9a390c72a7e0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:40.345553 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a9e124d-03be-483d-b058-9a390c72a7e0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:40.346202 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a9e124d-03be-483d-b058-9a390c72a7e0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:40.347130 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a9e124d-03be-483d-b058-9a390c72a7e0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:40.347794 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1a9e124d-03be-483d-b058-9a390c72a7e0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:40.436269 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1a9e124d-03be-483d-b058-9a390c72a7e0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105845 Jul 25 12:15:40.437115 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 77/148] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Jul 25 12:15:40 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:15:40.444783 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ef592923-3135-4df0-b676-2a34fe1d93e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:40.445396 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ef592923-3135-4df0-b676-2a34fe1d93e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:40.452552 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef592923-3135-4df0-b676-2a34fe1d93e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:40.453431 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef592923-3135-4df0-b676-2a34fe1d93e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:40.457895 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef592923-3135-4df0-b676-2a34fe1d93e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:40.458706 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef592923-3135-4df0-b676-2a34fe1d93e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:40.784274 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ef592923-3135-4df0-b676-2a34fe1d93e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:40.793688 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ef592923-3135-4df0-b676-2a34fe1d93e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.352560 Jul 25 12:15:40.795186 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 72/149] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:40 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:41.818796 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-515bad78-7bbc-4039-ab48-e93cefd8a1f8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:41.820441 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-515bad78-7bbc-4039-ab48-e93cefd8a1f8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:41.829520 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-515bad78-7bbc-4039-ab48-e93cefd8a1f8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:41.830149 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-515bad78-7bbc-4039-ab48-e93cefd8a1f8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:41.832264 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-515bad78-7bbc-4039-ab48-e93cefd8a1f8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:41.833316 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-515bad78-7bbc-4039-ab48-e93cefd8a1f8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:41.913224 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-f7c1212d-3ca5-4d27-bfef-824c47ea2c71 req-a93bde46-31f5-45a1-a210-9fa26eb3b986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d50aae7-fb06-467c-9a21-1d683297bc9e", "tag": "59a6c2e2-7638-469a-bca1-c81f367ece3f"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:41.925143 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-f7c1212d-3ca5-4d27-bfef-824c47ea2c71 req-a93bde46-31f5-45a1-a210-9fa26eb3b986 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:41.926067 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-f7c1212d-3ca5-4d27-bfef-824c47ea2c71 req-a93bde46-31f5-45a1-a210-9fa26eb3b986 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:41.941097 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-f7c1212d-3ca5-4d27-bfef-824c47ea2c71 req-a93bde46-31f5-45a1-a210-9fa26eb3b986 service nova] Creating event network-changed:59a6c2e2-7638-469a-bca1-c81f367ece3f for instance 3d50aae7-fb06-467c-9a21-1d683297bc9e on hv-cinder-79760 Jul 25 12:15:41.946970 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-f7c1212d-3ca5-4d27-bfef-824c47ea2c71 req-a93bde46-31f5-45a1-a210-9fa26eb3b986 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038213 Jul 25 12:15:41.950388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 73/150] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:15:42.232843 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-515bad78-7bbc-4039-ab48-e93cefd8a1f8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:42.245213 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-515bad78-7bbc-4039-ab48-e93cefd8a1f8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.429921 Jul 25 12:15:42.246449 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 78/151] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:41 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:43.266690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4fb63396-8368-4a18-8391-34ee11c49eb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:43.267945 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4fb63396-8368-4a18-8391-34ee11c49eb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:43.278139 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fb63396-8368-4a18-8391-34ee11c49eb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:43.278770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fb63396-8368-4a18-8391-34ee11c49eb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:43.279737 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fb63396-8368-4a18-8391-34ee11c49eb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:43.280318 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fb63396-8368-4a18-8391-34ee11c49eb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:43.531492 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4fb63396-8368-4a18-8391-34ee11c49eb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:43.546867 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4fb63396-8368-4a18-8391-34ee11c49eb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.281145 Jul 25 12:15:43.547584 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 74/152] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:43 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:44.574430 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8c98c163-12f6-4765-baa8-8e2d0da6a5ef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:44.575797 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8c98c163-12f6-4765-baa8-8e2d0da6a5ef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:44.592948 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c98c163-12f6-4765-baa8-8e2d0da6a5ef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:44.593407 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c98c163-12f6-4765-baa8-8e2d0da6a5ef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:44.596476 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c98c163-12f6-4765-baa8-8e2d0da6a5ef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:44.597103 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c98c163-12f6-4765-baa8-8e2d0da6a5ef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:45.166742 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8c98c163-12f6-4765-baa8-8e2d0da6a5ef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:45.184662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8c98c163-12f6-4765-baa8-8e2d0da6a5ef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.616347 Jul 25 12:15:45.185813 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 79/153] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:44 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:46.225472 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-894f3d9d-2d2b-4b35-9026-f4959f4b8e47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:46.227242 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-894f3d9d-2d2b-4b35-9026-f4959f4b8e47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:46.234744 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-894f3d9d-2d2b-4b35-9026-f4959f4b8e47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:46.235438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-894f3d9d-2d2b-4b35-9026-f4959f4b8e47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:46.236801 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-894f3d9d-2d2b-4b35-9026-f4959f4b8e47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:46.237554 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-894f3d9d-2d2b-4b35-9026-f4959f4b8e47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:46.497253 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-894f3d9d-2d2b-4b35-9026-f4959f4b8e47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:46.510267 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-894f3d9d-2d2b-4b35-9026-f4959f4b8e47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.292713 Jul 25 12:15:46.510859 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 75/154] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:46 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:46.621479 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-604460822", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "networks": [{"uuid": "c68dde59-1544-4fd3-8e4e-babe3594a8bb"}]}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:46.656506 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=88 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:46.727917 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] validate_networks() for [('c68dde59-1544-4fd3-8e4e-babe3594a8bb', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:15:47.499997 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:15:47.500540 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:15:47.501087 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:15:47.501577 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:15:47.502213 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:15:47.520341 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:47.522948 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:47.533225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:47.534109 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:47.538838 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-62916c5d-6d67-483f-a910-bf6abbf67989 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:47.544493 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-62916c5d-6d67-483f-a910-bf6abbf67989 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:47.566262 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Getting quotas for project 91bd04f2c9d34640ab6317fc8dd3dddb. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:15:47.572942 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Getting quotas for user 5f696b65c8094119af332e7e837b888e and project 91bd04f2c9d34640ab6317fc8dd3dddb. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:15:47.592938 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62916c5d-6d67-483f-a910-bf6abbf67989 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:47.594818 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:15:47.595575 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62916c5d-6d67-483f-a910-bf6abbf67989 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:47.597422 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62916c5d-6d67-483f-a910-bf6abbf67989 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:47.600341 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-62916c5d-6d67-483f-a910-bf6abbf67989 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:47.600610 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:15:47.689311 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6116ddd3-6b98-410b-8abf-350447f9a664 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073589 Jul 25 12:15:47.690290 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 80/155] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:15:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:15:47.701018 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9fecff39-369d-4d20-951f-994c641f99d0 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:47.701521 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9fecff39-369d-4d20-951f-994c641f99d0 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:47.932707 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-62916c5d-6d67-483f-a910-bf6abbf67989 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:47.941887 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-62916c5d-6d67-483f-a910-bf6abbf67989 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.407787 Jul 25 12:15:47.942500 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 76/156] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:47 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:47.953468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5bd582d5-e527-4af9-b083-db025c57a59e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:47.954559 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5bd582d5-e527-4af9-b083-db025c57a59e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:47.962809 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bd582d5-e527-4af9-b083-db025c57a59e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:47.963870 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bd582d5-e527-4af9-b083-db025c57a59e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:47.965753 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bd582d5-e527-4af9-b083-db025c57a59e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:47.966728 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5bd582d5-e527-4af9-b083-db025c57a59e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:47.995867 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5bd582d5-e527-4af9-b083-db025c57a59e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:15:48.000545 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9fecff39-369d-4d20-951f-994c641f99d0 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:48.012938 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9fecff39-369d-4d20-951f-994c641f99d0 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1213 microversion: 2.1 time: 0.315969 Jul 25 12:15:48.015036 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 81/157] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:47 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1213 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:48.145467 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5bd582d5-e527-4af9-b083-db025c57a59e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "DELETE /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 204 len: 0 microversion: 2.1 time: 0.201247 Jul 25 12:15:48.147516 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 77/158] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:15:47 2022] DELETE /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:15:48.164678 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-860afde5-807b-425e-8b84-538b0397c6fa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:48.165522 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-860afde5-807b-425e-8b84-538b0397c6fa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:48.173146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-860afde5-807b-425e-8b84-538b0397c6fa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:48.173646 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-860afde5-807b-425e-8b84-538b0397c6fa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:48.174413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-860afde5-807b-425e-8b84-538b0397c6fa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:48.175090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-860afde5-807b-425e-8b84-538b0397c6fa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:48.394791 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-860afde5-807b-425e-8b84-538b0397c6fa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:48.405010 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-860afde5-807b-425e-8b84-538b0397c6fa tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1554 microversion: 2.1 time: 0.252967 Jul 25 12:15:48.424891 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 82/159] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:48 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1554 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:48.963438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c83e768b-9a1f-4294-9cbe-6c506ea35ab0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:48.964177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c83e768b-9a1f-4294-9cbe-6c506ea35ab0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:48.970473 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c83e768b-9a1f-4294-9cbe-6c506ea35ab0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:48.970897 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c83e768b-9a1f-4294-9cbe-6c506ea35ab0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:48.971764 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c83e768b-9a1f-4294-9cbe-6c506ea35ab0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:48.972202 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c83e768b-9a1f-4294-9cbe-6c506ea35ab0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:49.036673 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bb99e5f2-42d4-4022-89b7-b51a55e80f83 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:49.038711 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bb99e5f2-42d4-4022-89b7-b51a55e80f83 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:49.045744 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb99e5f2-42d4-4022-89b7-b51a55e80f83 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:49.046425 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb99e5f2-42d4-4022-89b7-b51a55e80f83 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:49.047349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb99e5f2-42d4-4022-89b7-b51a55e80f83 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:49.048025 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb99e5f2-42d4-4022-89b7-b51a55e80f83 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:49.120411 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c83e768b-9a1f-4294-9cbe-6c506ea35ab0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:49.132638 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c83e768b-9a1f-4294-9cbe-6c506ea35ab0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.173295 Jul 25 12:15:49.134450 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 78/160] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:48 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:49.323270 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bb99e5f2-42d4-4022-89b7-b51a55e80f83 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:49.332368 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bb99e5f2-42d4-4022-89b7-b51a55e80f83 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1217 microversion: 2.1 time: 0.300058 Jul 25 12:15:49.333360 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 83/161] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:49 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1217 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:49.435078 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f0b09d2b-1c92-4311-b5e9-312d22d4bf15 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:49.436317 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f0b09d2b-1c92-4311-b5e9-312d22d4bf15 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:49.443769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f0b09d2b-1c92-4311-b5e9-312d22d4bf15 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:49.444407 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f0b09d2b-1c92-4311-b5e9-312d22d4bf15 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:49.445612 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f0b09d2b-1c92-4311-b5e9-312d22d4bf15 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:49.446047 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f0b09d2b-1c92-4311-b5e9-312d22d4bf15 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:49.649261 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f0b09d2b-1c92-4311-b5e9-312d22d4bf15 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:49.657347 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f0b09d2b-1c92-4311-b5e9-312d22d4bf15 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1554 microversion: 2.1 time: 0.228817 Jul 25 12:15:49.657919 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 79/162] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:49 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:50.163882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-41d59195-4b99-4565-b3f2-eb3b4a886ed3 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:50.164671 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-41d59195-4b99-4565-b3f2-eb3b4a886ed3 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:50.179232 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41d59195-4b99-4565-b3f2-eb3b4a886ed3 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:50.180931 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41d59195-4b99-4565-b3f2-eb3b4a886ed3 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:50.182040 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41d59195-4b99-4565-b3f2-eb3b4a886ed3 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:50.182683 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-41d59195-4b99-4565-b3f2-eb3b4a886ed3 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:50.355007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4cc8afa3-c3e8-4443-b10b-db3fdc2b2f0b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:50.355418 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4cc8afa3-c3e8-4443-b10b-db3fdc2b2f0b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:50.366937 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4cc8afa3-c3e8-4443-b10b-db3fdc2b2f0b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:50.372087 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4cc8afa3-c3e8-4443-b10b-db3fdc2b2f0b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:50.373167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4cc8afa3-c3e8-4443-b10b-db3fdc2b2f0b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:50.373746 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4cc8afa3-c3e8-4443-b10b-db3fdc2b2f0b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:50.446858 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4cc8afa3-c3e8-4443-b10b-db3fdc2b2f0b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:50.457064 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4cc8afa3-c3e8-4443-b10b-db3fdc2b2f0b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1265 microversion: 2.1 time: 0.106216 Jul 25 12:15:50.458024 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 80/163] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:50 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:50.518166 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-41d59195-4b99-4565-b3f2-eb3b4a886ed3 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:50.533248 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-41d59195-4b99-4565-b3f2-eb3b4a886ed3 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.375991 Jul 25 12:15:50.534204 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 84/164] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:50 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:50.680398 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3a80ea36-13dc-4bfc-b055-b1c733294817 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:50.682321 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3a80ea36-13dc-4bfc-b055-b1c733294817 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:50.688079 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3a80ea36-13dc-4bfc-b055-b1c733294817 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:50.688526 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3a80ea36-13dc-4bfc-b055-b1c733294817 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:50.689568 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3a80ea36-13dc-4bfc-b055-b1c733294817 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:50.690093 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3a80ea36-13dc-4bfc-b055-b1c733294817 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:50.873431 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3a80ea36-13dc-4bfc-b055-b1c733294817 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:50.884785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3a80ea36-13dc-4bfc-b055-b1c733294817 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1554 microversion: 2.1 time: 0.208525 Jul 25 12:15:50.887954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 81/165] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:50 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:51.481012 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-08736acc-2b45-4dec-bf8a-8baa37b5a3e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:51.482226 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-08736acc-2b45-4dec-bf8a-8baa37b5a3e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:51.491083 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08736acc-2b45-4dec-bf8a-8baa37b5a3e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:51.491826 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08736acc-2b45-4dec-bf8a-8baa37b5a3e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:51.492762 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08736acc-2b45-4dec-bf8a-8baa37b5a3e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:51.493332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-08736acc-2b45-4dec-bf8a-8baa37b5a3e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:51.556177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-35cbe5d1-f797-4935-9d93-854142fa7a20 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:51.557566 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-35cbe5d1-f797-4935-9d93-854142fa7a20 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:51.564130 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35cbe5d1-f797-4935-9d93-854142fa7a20 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:51.564726 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35cbe5d1-f797-4935-9d93-854142fa7a20 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:51.565562 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35cbe5d1-f797-4935-9d93-854142fa7a20 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:51.566061 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-35cbe5d1-f797-4935-9d93-854142fa7a20 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:51.714839 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-35cbe5d1-f797-4935-9d93-854142fa7a20 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:51.723289 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-35cbe5d1-f797-4935-9d93-854142fa7a20 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.172566 Jul 25 12:15:51.724966 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 82/166] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:51 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:51.916241 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-51f3fc5f-7976-4f62-b522-8cf2bf1e4ba7 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:51.916916 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-51f3fc5f-7976-4f62-b522-8cf2bf1e4ba7 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:51.925044 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51f3fc5f-7976-4f62-b522-8cf2bf1e4ba7 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:51.925505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51f3fc5f-7976-4f62-b522-8cf2bf1e4ba7 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:51.926287 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51f3fc5f-7976-4f62-b522-8cf2bf1e4ba7 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:51.926741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51f3fc5f-7976-4f62-b522-8cf2bf1e4ba7 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:52.037761 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-08736acc-2b45-4dec-bf8a-8baa37b5a3e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:52.049326 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-08736acc-2b45-4dec-bf8a-8baa37b5a3e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1271 microversion: 2.1 time: 0.572865 Jul 25 12:15:52.051975 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 85/167] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:51 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1271 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:52.222496 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-51f3fc5f-7976-4f62-b522-8cf2bf1e4ba7 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:52.234950 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-51f3fc5f-7976-4f62-b522-8cf2bf1e4ba7 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1554 microversion: 2.1 time: 0.327168 Jul 25 12:15:52.238399 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 83/168] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:51 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1554 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:52.746869 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8fc10968-1bf5-4fc9-ae12-ee805ef30f47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:52.748652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8fc10968-1bf5-4fc9-ae12-ee805ef30f47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:52.756675 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fc10968-1bf5-4fc9-ae12-ee805ef30f47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:52.757489 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fc10968-1bf5-4fc9-ae12-ee805ef30f47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:52.758422 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fc10968-1bf5-4fc9-ae12-ee805ef30f47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:52.760449 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fc10968-1bf5-4fc9-ae12-ee805ef30f47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:52.819096 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-73d9edfa-8167-4e08-b9bb-54c76af32f89 req-9b20cf31-8b05-4a1d-8e58-386d70dbf30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ec6126-ab67-4094-ade6-816f0e39ba46", "name": "network-vif-deleted", "tag": "3b24bc1b-53c9-4417-92af-4eb343429851"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:52.832874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-73d9edfa-8167-4e08-b9bb-54c76af32f89 req-9b20cf31-8b05-4a1d-8e58-386d70dbf30a service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:52.833306 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-73d9edfa-8167-4e08-b9bb-54c76af32f89 req-9b20cf31-8b05-4a1d-8e58-386d70dbf30a service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:52.868361 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-73d9edfa-8167-4e08-b9bb-54c76af32f89 req-9b20cf31-8b05-4a1d-8e58-386d70dbf30a service nova] Creating event network-vif-deleted:3b24bc1b-53c9-4417-92af-4eb343429851 for instance 03ec6126-ab67-4094-ade6-816f0e39ba46 on hv-cinder-79760 Jul 25 12:15:52.879937 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-73d9edfa-8167-4e08-b9bb-54c76af32f89 req-9b20cf31-8b05-4a1d-8e58-386d70dbf30a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068492 Jul 25 12:15:52.883938 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 84/169] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:15:53.081872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-837d1e85-b67c-429c-83c5-2090f6f171c9 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:53.085580 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-837d1e85-b67c-429c-83c5-2090f6f171c9 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:53.106077 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-837d1e85-b67c-429c-83c5-2090f6f171c9 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:53.109006 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-837d1e85-b67c-429c-83c5-2090f6f171c9 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:53.113620 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-837d1e85-b67c-429c-83c5-2090f6f171c9 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:53.114081 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-837d1e85-b67c-429c-83c5-2090f6f171c9 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:53.349573 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-837d1e85-b67c-429c-83c5-2090f6f171c9 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:53.361206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-837d1e85-b67c-429c-83c5-2090f6f171c9 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1271 microversion: 2.1 time: 0.289088 Jul 25 12:15:53.361810 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 85/170] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:53 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1271 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:53.370402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cdd942ce-0692-4be3-b351-5bbf93e995ff tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:53.371017 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cdd942ce-0692-4be3-b351-5bbf93e995ff tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:53.382086 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdd942ce-0692-4be3-b351-5bbf93e995ff tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:53.382781 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdd942ce-0692-4be3-b351-5bbf93e995ff tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:53.383673 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdd942ce-0692-4be3-b351-5bbf93e995ff tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:53.385353 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdd942ce-0692-4be3-b351-5bbf93e995ff tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:53.393612 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8fc10968-1bf5-4fc9-ae12-ee805ef30f47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:53.403511 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8fc10968-1bf5-4fc9-ae12-ee805ef30f47 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.662039 Jul 25 12:15:53.431850 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 86/171] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:52 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:53.449092 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdd942ce-0692-4be3-b351-5bbf93e995ff tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:53.449552 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cdd942ce-0692-4be3-b351-5bbf93e995ff tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:53.450048 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-cdd942ce-0692-4be3-b351-5bbf93e995ff tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lazy-loading 'fault' on Instance uuid 03ec6126-ab67-4094-ade6-816f0e39ba46 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:15:53.527956 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cdd942ce-0692-4be3-b351-5bbf93e995ff tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a96a9ce9db422f96927b7f59606998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e8cdf9803c4388a79e123894ab34b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:53.532384 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:53.550178 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cdd942ce-0692-4be3-b351-5bbf93e995ff tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 200 len: 1351 microversion: 2.1 time: 0.187091 Jul 25 12:15:53.551091 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 86/172] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:53 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 1351 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:54.388225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a198a03d-2ffb-499c-8ac6-ec7ff76ffe51 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:54.389015 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a198a03d-2ffb-499c-8ac6-ec7ff76ffe51 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:54.400685 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a198a03d-2ffb-499c-8ac6-ec7ff76ffe51 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:54.401121 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a198a03d-2ffb-499c-8ac6-ec7ff76ffe51 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:54.404925 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a198a03d-2ffb-499c-8ac6-ec7ff76ffe51 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:54.407304 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a198a03d-2ffb-499c-8ac6-ec7ff76ffe51 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:54.443451 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-59ba9363-dc2e-4522-9b2a-89e02a6e6b8a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:54.444344 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-59ba9363-dc2e-4522-9b2a-89e02a6e6b8a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:54.462326 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59ba9363-dc2e-4522-9b2a-89e02a6e6b8a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:54.462793 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59ba9363-dc2e-4522-9b2a-89e02a6e6b8a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:54.464949 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59ba9363-dc2e-4522-9b2a-89e02a6e6b8a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:54.468046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59ba9363-dc2e-4522-9b2a-89e02a6e6b8a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:54.748628 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-59ba9363-dc2e-4522-9b2a-89e02a6e6b8a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:54.760083 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-59ba9363-dc2e-4522-9b2a-89e02a6e6b8a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.322955 Jul 25 12:15:54.762227 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 87/173] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:54 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:54.785707 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f1ddaaf8-f08c-460d-8547-549b8983d334 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:54.786707 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f1ddaaf8-f08c-460d-8547-549b8983d334 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:54.816232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f1ddaaf8-f08c-460d-8547-549b8983d334 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:54.817095 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f1ddaaf8-f08c-460d-8547-549b8983d334 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:54.821845 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f1ddaaf8-f08c-460d-8547-549b8983d334 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:54.822843 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f1ddaaf8-f08c-460d-8547-549b8983d334 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:54.851277 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-f1ddaaf8-f08c-460d-8547-549b8983d334 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] HTTP exception thrown: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f1ddaaf8-f08c-460d-8547-549b8983d334 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Request method failure captured: Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 HTTP/1.1 Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3olCuYIlr0001TZRp8VMRYaKgSxI7-9Ak6sP9hSa31cYqnaT_aRsoQVuSfhCHto-Xlt-jB1sJPg1rr8xRoxdfc9ZpHWoRR0Jc2YANTOBD2blOm5fjCRL6pOrZxLGgeMhfTpQltWMcB89KEOiDG3sZlCcny8x78jv-OJw85Utfdvjr8o Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 05e8cdf9803c4388a79e123894ab34b1 Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-DeleteServersTestJSON-1821900313 Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:15:54.857020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:15:54.858286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:15:54.858286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-DeleteServersTestJSON-1821900313 Jul 25 12:15:54.858286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 05e8cdf9803c4388a79e123894ab34b1 Jul 25 12:15:54.858286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-DeleteServersTestJSON-1821900313 Jul 25 12:15:54.858286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-DeleteServersTestJSON-1821900313-project Jul 25 12:15:54.858286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:15:54.858286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:15:54.858286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 89a96a9ce9db422f96927b7f59606998 Jul 25 12:15:54.858286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-DeleteServersTestJSON-1821900313-project Jul 25 12:15:54.858286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:15:54.858286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:54.858286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '03ec6126-ab67-4094-ade6-816f0e39ba46'} Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:15:54.858981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:54.860741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:54.866357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f1ddaaf8-f08c-460d-8547-549b8983d334 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Returning 404 to user: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:15:54.867516 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f1ddaaf8-f08c-460d-8547-549b8983d334 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 404 len: 111 microversion: 2.1 time: 0.104126 Jul 25 12:15:54.868492 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 88/174] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:54 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:15:55.024233 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a198a03d-2ffb-499c-8ac6-ec7ff76ffe51 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:55.050927 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a198a03d-2ffb-499c-8ac6-ec7ff76ffe51 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1313 microversion: 2.1 time: 0.671715 Jul 25 12:15:55.056524 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 87/175] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:54 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:55.136112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e7020232-df6a-4009-b1a2-4a62dec07a58 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:55.138615 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e7020232-df6a-4009-b1a2-4a62dec07a58 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:55.164062 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e7020232-df6a-4009-b1a2-4a62dec07a58 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:55.169158 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e7020232-df6a-4009-b1a2-4a62dec07a58 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:55.173700 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e7020232-df6a-4009-b1a2-4a62dec07a58 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:55.174343 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e7020232-df6a-4009-b1a2-4a62dec07a58 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:55.210834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-e7020232-df6a-4009-b1a2-4a62dec07a58 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] HTTP exception thrown: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e7020232-df6a-4009-b1a2-4a62dec07a58 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Request method failure captured: Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46/os-volume_attachments HTTP/1.1 Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3olCuYIlr0001TZRp8VMRYaKgSxI7-9Ak6sP9hSa31cYqnaT_aRsoQVuSfhCHto-Xlt-jB1sJPg1rr8xRoxdfc9ZpHWoRR0Jc2YANTOBD2blOm5fjCRL6pOrZxLGgeMhfTpQltWMcB89KEOiDG3sZlCcny8x78jv-OJw85Utfdvjr8o Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 05e8cdf9803c4388a79e123894ab34b1 Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-DeleteServersTestJSON-1821900313 Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:15:55.218359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:15:55.219872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:15:55.219872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-DeleteServersTestJSON-1821900313 Jul 25 12:15:55.219872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 05e8cdf9803c4388a79e123894ab34b1 Jul 25 12:15:55.219872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-DeleteServersTestJSON-1821900313 Jul 25 12:15:55.219872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-DeleteServersTestJSON-1821900313-project Jul 25 12:15:55.219872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:15:55.219872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:15:55.219872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 89a96a9ce9db422f96927b7f59606998 Jul 25 12:15:55.219872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-DeleteServersTestJSON-1821900313-project Jul 25 12:15:55.219872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:15:55.219872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:55.219872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'server_id': '03ec6126-ab67-4094-ade6-816f0e39ba46'} Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:15:55.220696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:55.221980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:55.224788 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e7020232-df6a-4009-b1a2-4a62dec07a58 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Returning 404 to user: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:15:55.225814 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e7020232-df6a-4009-b1a2-4a62dec07a58 tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.094082 Jul 25 12:15:55.228517 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 89/176] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:15:55 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46/os-volume_attachments => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:15:55.730955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-69ebcf9d-cfc2-4e52-8aea-e8570c2b1752 req-2f2e84df-74da-4264-bbb8-89fc353de38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6ae1afa-6fd5-478b-8c01-6172efd19ee5", "tag": "29156948-b400-434f-ba82-bb5568519914"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:15:55.753531 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-69ebcf9d-cfc2-4e52-8aea-e8570c2b1752 req-2f2e84df-74da-4264-bbb8-89fc353de38b service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:55.754316 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-69ebcf9d-cfc2-4e52-8aea-e8570c2b1752 req-2f2e84df-74da-4264-bbb8-89fc353de38b service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:55.786843 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-69ebcf9d-cfc2-4e52-8aea-e8570c2b1752 req-2f2e84df-74da-4264-bbb8-89fc353de38b service nova] Creating event network-changed:29156948-b400-434f-ba82-bb5568519914 for instance d6ae1afa-6fd5-478b-8c01-6172efd19ee5 on hv-cinder-79760 Jul 25 12:15:55.787059 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-51cfc515-1651-4f55-b285-2777bf8f79b6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:55.788270 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-51cfc515-1651-4f55-b285-2777bf8f79b6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:55.793366 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-69ebcf9d-cfc2-4e52-8aea-e8570c2b1752 req-2f2e84df-74da-4264-bbb8-89fc353de38b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067939 Jul 25 12:15:55.794780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 88/177] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:15:55.800761 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51cfc515-1651-4f55-b285-2777bf8f79b6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:55.801211 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51cfc515-1651-4f55-b285-2777bf8f79b6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:55.802433 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51cfc515-1651-4f55-b285-2777bf8f79b6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:55.802897 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-51cfc515-1651-4f55-b285-2777bf8f79b6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:55.948792 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-51cfc515-1651-4f55-b285-2777bf8f79b6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:55.957906 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-51cfc515-1651-4f55-b285-2777bf8f79b6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.178019 Jul 25 12:15:55.959587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 90/178] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:55 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:15:56.078275 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c842989b-ca05-425c-b005-bb85ed5ad20f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:56.078969 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c842989b-ca05-425c-b005-bb85ed5ad20f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:56.086237 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c842989b-ca05-425c-b005-bb85ed5ad20f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:56.086680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c842989b-ca05-425c-b005-bb85ed5ad20f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:56.087519 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c842989b-ca05-425c-b005-bb85ed5ad20f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:56.088125 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c842989b-ca05-425c-b005-bb85ed5ad20f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:56.424485 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c842989b-ca05-425c-b005-bb85ed5ad20f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:56.450150 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c842989b-ca05-425c-b005-bb85ed5ad20f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1313 microversion: 2.1 time: 0.368656 Jul 25 12:15:56.452443 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 89/179] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:56 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:56.574100 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f641c7c1-41c3-4e65-932b-ad5b98808c1e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:56.574765 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f641c7c1-41c3-4e65-932b-ad5b98808c1e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:56.581476 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f641c7c1-41c3-4e65-932b-ad5b98808c1e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:56.586870 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f641c7c1-41c3-4e65-932b-ad5b98808c1e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:56.592235 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f641c7c1-41c3-4e65-932b-ad5b98808c1e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:56.593088 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f641c7c1-41c3-4e65-932b-ad5b98808c1e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:56.612569 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-f641c7c1-41c3-4e65-932b-ad5b98808c1e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] HTTP exception thrown: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f641c7c1-41c3-4e65-932b-ad5b98808c1e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Request method failure captured: Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: DELETE /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 HTTP/1.1 Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3olCuYIlr0001TZRp8VMRYaKgSxI7-9Ak6sP9hSa31cYqnaT_aRsoQVuSfhCHto-Xlt-jB1sJPg1rr8xRoxdfc9ZpHWoRR0Jc2YANTOBD2blOm5fjCRL6pOrZxLGgeMhfTpQltWMcB89KEOiDG3sZlCcny8x78jv-OJw85Utfdvjr8o Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 05e8cdf9803c4388a79e123894ab34b1 Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-DeleteServersTestJSON-1821900313 Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:15:56.614248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:15:56.616503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:15:56.616503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-DeleteServersTestJSON-1821900313 Jul 25 12:15:56.616503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 05e8cdf9803c4388a79e123894ab34b1 Jul 25 12:15:56.616503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-DeleteServersTestJSON-1821900313 Jul 25 12:15:56.616503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-DeleteServersTestJSON-1821900313-project Jul 25 12:15:56.616503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:15:56.616503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:15:56.616503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 89a96a9ce9db422f96927b7f59606998 Jul 25 12:15:56.616503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-DeleteServersTestJSON-1821900313-project Jul 25 12:15:56.616503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:15:56.616503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:56.616503 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '03ec6126-ab67-4094-ade6-816f0e39ba46'} Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:15:56.617239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:56.618724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:15:56.636249 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f641c7c1-41c3-4e65-932b-ad5b98808c1e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Returning 404 to user: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:15:56.637702 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f641c7c1-41c3-4e65-932b-ad5b98808c1e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "DELETE /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 404 len: 111 microversion: 2.1 time: 0.067704 Jul 25 12:15:56.639195 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 91/180] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:15:56 2022] DELETE /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:15:56.647255 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d1908b30-6b56-47ab-b693-0afad282960e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:56.649070 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d1908b30-6b56-47ab-b693-0afad282960e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] [instance: 03ec6126-ab67-4094-ade6-816f0e39ba46] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:56.658173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1908b30-6b56-47ab-b693-0afad282960e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:56.660963 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1908b30-6b56-47ab-b693-0afad282960e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:56.662717 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1908b30-6b56-47ab-b693-0afad282960e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:56.663381 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1908b30-6b56-47ab-b693-0afad282960e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:56.681520 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-d1908b30-6b56-47ab-b693-0afad282960e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] HTTP exception thrown: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d1908b30-6b56-47ab-b693-0afad282960e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Request method failure captured: Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 HTTP/1.1 Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3olCuYIlr0001TZRp8VMRYaKgSxI7-9Ak6sP9hSa31cYqnaT_aRsoQVuSfhCHto-Xlt-jB1sJPg1rr8xRoxdfc9ZpHWoRR0Jc2YANTOBD2blOm5fjCRL6pOrZxLGgeMhfTpQltWMcB89KEOiDG3sZlCcny8x78jv-OJw85Utfdvjr8o Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 05e8cdf9803c4388a79e123894ab34b1 Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-DeleteServersTestJSON-1821900313 Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:15:56.686396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:15:56.687680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05e8cdf9803c4388a79e123894ab34b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:15:56.687680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-DeleteServersTestJSON-1821900313 Jul 25 12:15:56.687680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 05e8cdf9803c4388a79e123894ab34b1 Jul 25 12:15:56.687680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-DeleteServersTestJSON-1821900313 Jul 25 12:15:56.687680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-DeleteServersTestJSON-1821900313-project Jul 25 12:15:56.687680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:15:56.687680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:15:56.687680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 89a96a9ce9db422f96927b7f59606998 Jul 25 12:15:56.687680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-DeleteServersTestJSON-1821900313-project Jul 25 12:15:56.687680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:15:56.687680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:56.687680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': '03ec6126-ab67-4094-ade6-816f0e39ba46'} Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:15:56.688317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. Jul 25 12:15:56.689655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:15:56.690568 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d1908b30-6b56-47ab-b693-0afad282960e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] Returning 404 to user: Instance 03ec6126-ab67-4094-ade6-816f0e39ba46 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:15:56.690568 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d1908b30-6b56-47ab-b693-0afad282960e tempest-DeleteServersTestJSON-1821900313 tempest-DeleteServersTestJSON-1821900313-project] 10.222.0.42 "GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46" status: 404 len: 111 microversion: 2.1 time: 0.044724 Jul 25 12:15:56.690568 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 90/181] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:56 2022] GET /compute/v2.1/servers/03ec6126-ab67-4094-ade6-816f0e39ba46 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:15:56.980418 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-47780631-9f0a-47fb-8936-e68d1568aa64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:56.981034 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-47780631-9f0a-47fb-8936-e68d1568aa64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:56.987282 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47780631-9f0a-47fb-8936-e68d1568aa64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:56.988386 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47780631-9f0a-47fb-8936-e68d1568aa64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:56.989412 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47780631-9f0a-47fb-8936-e68d1568aa64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:56.990140 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-47780631-9f0a-47fb-8936-e68d1568aa64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:57.267602 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-47780631-9f0a-47fb-8936-e68d1568aa64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:57.276815 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-47780631-9f0a-47fb-8936-e68d1568aa64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.300261 Jul 25 12:15:57.277391 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 92/182] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:56 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:57.474656 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8d14b045-a559-45b1-b0d8-e559006b803a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:57.475441 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8d14b045-a559-45b1-b0d8-e559006b803a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:57.487012 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d14b045-a559-45b1-b0d8-e559006b803a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:57.487796 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d14b045-a559-45b1-b0d8-e559006b803a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:57.489091 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d14b045-a559-45b1-b0d8-e559006b803a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:57.492415 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8d14b045-a559-45b1-b0d8-e559006b803a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:57.554153 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:57.650974 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8d14b045-a559-45b1-b0d8-e559006b803a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:57.663200 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8d14b045-a559-45b1-b0d8-e559006b803a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1313 microversion: 2.1 time: 0.193236 Jul 25 12:15:57.666049 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 91/183] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:57 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:58.297942 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3ff1434c-d24f-4521-ab81-6c1dad027544 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:58.299399 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3ff1434c-d24f-4521-ab81-6c1dad027544 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:58.309048 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ff1434c-d24f-4521-ab81-6c1dad027544 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:58.310037 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ff1434c-d24f-4521-ab81-6c1dad027544 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:58.311030 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ff1434c-d24f-4521-ab81-6c1dad027544 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:58.311684 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ff1434c-d24f-4521-ab81-6c1dad027544 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:58.689386 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-22ac5471-7da1-4a14-a513-49ae3ce299c3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:15:58.691207 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-22ac5471-7da1-4a14-a513-49ae3ce299c3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:15:58.694540 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=8 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:58.707740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22ac5471-7da1-4a14-a513-49ae3ce299c3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:58.722268 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22ac5471-7da1-4a14-a513-49ae3ce299c3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:58.727342 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22ac5471-7da1-4a14-a513-49ae3ce299c3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:15:58.737829 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-22ac5471-7da1-4a14-a513-49ae3ce299c3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:15:58.975936 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3ff1434c-d24f-4521-ab81-6c1dad027544 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:58.989617 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3ff1434c-d24f-4521-ab81-6c1dad027544 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.690785 Jul 25 12:15:58.990583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 93/184] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:58 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:15:58.997980 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-22ac5471-7da1-4a14-a513-49ae3ce299c3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:15:59.011975 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-22ac5471-7da1-4a14-a513-49ae3ce299c3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1313 microversion: 2.1 time: 0.327800 Jul 25 12:15:59.013023 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 92/185] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:15:58 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:00.011637 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-44d8b0d2-2a04-46ca-99e0-78039e4855d9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:00.012307 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-44d8b0d2-2a04-46ca-99e0-78039e4855d9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:00.048276 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44d8b0d2-2a04-46ca-99e0-78039e4855d9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:00.049274 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44d8b0d2-2a04-46ca-99e0-78039e4855d9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:00.052623 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44d8b0d2-2a04-46ca-99e0-78039e4855d9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:00.054423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44d8b0d2-2a04-46ca-99e0-78039e4855d9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:00.118736 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-68043006-613f-4731-a433-18670160b458 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:00.119404 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-68043006-613f-4731-a433-18670160b458 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:00.135089 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68043006-613f-4731-a433-18670160b458 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:00.136036 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68043006-613f-4731-a433-18670160b458 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:00.137033 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68043006-613f-4731-a433-18670160b458 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:00.137668 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68043006-613f-4731-a433-18670160b458 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:00.314878 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-44d8b0d2-2a04-46ca-99e0-78039e4855d9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:00.330508 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-44d8b0d2-2a04-46ca-99e0-78039e4855d9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.323931 Jul 25 12:16:00.334854 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 94/186] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:00 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:00.715926 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-68043006-613f-4731-a433-18670160b458 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:00.734352 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-68043006-613f-4731-a433-18670160b458 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1313 microversion: 2.1 time: 0.617660 Jul 25 12:16:00.750394 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 93/187] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:00 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1313 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:01.358657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-80b4bea2-be87-467f-af55-6888322e74c4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:01.361527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-80b4bea2-be87-467f-af55-6888322e74c4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:01.377817 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-80b4bea2-be87-467f-af55-6888322e74c4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:01.380705 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-80b4bea2-be87-467f-af55-6888322e74c4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:01.381716 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-80b4bea2-be87-467f-af55-6888322e74c4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:01.384394 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-80b4bea2-be87-467f-af55-6888322e74c4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:01.758950 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-acb196a5-547f-4486-8408-9d59ab2c8b3f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:01.759582 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-acb196a5-547f-4486-8408-9d59ab2c8b3f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:01.771013 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-acb196a5-547f-4486-8408-9d59ab2c8b3f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:01.771765 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-acb196a5-547f-4486-8408-9d59ab2c8b3f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:01.772908 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-acb196a5-547f-4486-8408-9d59ab2c8b3f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:01.773496 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-acb196a5-547f-4486-8408-9d59ab2c8b3f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:01.799441 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-80b4bea2-be87-467f-af55-6888322e74c4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:01.810521 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-80b4bea2-be87-467f-af55-6888322e74c4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.456035 Jul 25 12:16:01.811345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 95/188] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:01 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:01.828225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:02.081590 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-acb196a5-547f-4486-8408-9d59ab2c8b3f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:02.091448 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-acb196a5-547f-4486-8408-9d59ab2c8b3f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1313 microversion: 2.1 time: 0.337106 Jul 25 12:16:02.094252 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 94/189] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:01 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:02.838464 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bbe44555-aea7-4a2e-9be9-0b3be4727cf7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:02.839895 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bbe44555-aea7-4a2e-9be9-0b3be4727cf7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:02.847340 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbe44555-aea7-4a2e-9be9-0b3be4727cf7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:02.849072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbe44555-aea7-4a2e-9be9-0b3be4727cf7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:02.851194 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbe44555-aea7-4a2e-9be9-0b3be4727cf7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:02.851981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bbe44555-aea7-4a2e-9be9-0b3be4727cf7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:03.041458 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bbe44555-aea7-4a2e-9be9-0b3be4727cf7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:03.055219 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bbe44555-aea7-4a2e-9be9-0b3be4727cf7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.220519 Jul 25 12:16:03.063697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 96/190] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:02 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:03.121611 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4d106c67-7fa6-4c6b-a0fc-1f096d7ab20c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:03.121611 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4d106c67-7fa6-4c6b-a0fc-1f096d7ab20c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:03.128355 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d106c67-7fa6-4c6b-a0fc-1f096d7ab20c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:03.131885 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d106c67-7fa6-4c6b-a0fc-1f096d7ab20c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:03.133042 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d106c67-7fa6-4c6b-a0fc-1f096d7ab20c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:03.133699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4d106c67-7fa6-4c6b-a0fc-1f096d7ab20c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:03.331847 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4d106c67-7fa6-4c6b-a0fc-1f096d7ab20c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:03.341784 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4d106c67-7fa6-4c6b-a0fc-1f096d7ab20c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1313 microversion: 2.1 time: 0.225620 Jul 25 12:16:03.355958 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 95/191] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:03 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:04.076184 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-096c9469-75c3-4d7b-a520-6cc4298047b7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:04.077734 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-096c9469-75c3-4d7b-a520-6cc4298047b7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:04.087437 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:04.089505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-096c9469-75c3-4d7b-a520-6cc4298047b7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:04.090495 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-096c9469-75c3-4d7b-a520-6cc4298047b7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:04.091334 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-096c9469-75c3-4d7b-a520-6cc4298047b7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:04.091955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-096c9469-75c3-4d7b-a520-6cc4298047b7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:04.245864 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-096c9469-75c3-4d7b-a520-6cc4298047b7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:04.255271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-096c9469-75c3-4d7b-a520-6cc4298047b7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.182446 Jul 25 12:16:04.255881 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 97/192] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:04 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:04.362334 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7cae624f-d2d0-45e9-b95c-0fce22b4b269 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:04.363190 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7cae624f-d2d0-45e9-b95c-0fce22b4b269 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:04.370504 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cae624f-d2d0-45e9-b95c-0fce22b4b269 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:04.371071 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cae624f-d2d0-45e9-b95c-0fce22b4b269 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:04.371971 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cae624f-d2d0-45e9-b95c-0fce22b4b269 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:04.372504 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cae624f-d2d0-45e9-b95c-0fce22b4b269 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:04.565268 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7cae624f-d2d0-45e9-b95c-0fce22b4b269 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:04.576537 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7cae624f-d2d0-45e9-b95c-0fce22b4b269 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1313 microversion: 2.1 time: 0.218154 Jul 25 12:16:04.577116 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 96/193] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:04 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:05.279624 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-552618db-41d2-425a-9749-d42e7b4aa483 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:05.280340 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-552618db-41d2-425a-9749-d42e7b4aa483 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:05.294092 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-552618db-41d2-425a-9749-d42e7b4aa483 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:05.294677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-552618db-41d2-425a-9749-d42e7b4aa483 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:05.295719 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-552618db-41d2-425a-9749-d42e7b4aa483 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:05.296418 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-552618db-41d2-425a-9749-d42e7b4aa483 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:05.449935 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-552618db-41d2-425a-9749-d42e7b4aa483 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:05.453252 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-552618db-41d2-425a-9749-d42e7b4aa483 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.178871 Jul 25 12:16:05.454009 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 98/194] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:05 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:05.620856 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4fd3ad8d-14d8-43fd-9621-5baf7e48145c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:05.625240 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4fd3ad8d-14d8-43fd-9621-5baf7e48145c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:05.640742 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4fd3ad8d-14d8-43fd-9621-5baf7e48145c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:05.641177 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4fd3ad8d-14d8-43fd-9621-5baf7e48145c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:05.641945 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4fd3ad8d-14d8-43fd-9621-5baf7e48145c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:05.642377 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4fd3ad8d-14d8-43fd-9621-5baf7e48145c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:05.813852 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c7c18791-edf8-48c8-9bd6-b88dffb334ee tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] Calling method '.version_select at 0x7f942c5ce820>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:05.838454 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4fd3ad8d-14d8-43fd-9621-5baf7e48145c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:05.847170 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4fd3ad8d-14d8-43fd-9621-5baf7e48145c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1313 microversion: 2.1 time: 0.252825 Jul 25 12:16:05.856456 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 97/195] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:05 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:05.889178 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c7c18791-edf8-48c8-9bd6-b88dffb334ee tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/be3faca8-b427-4ae2-a288-5859b6823b04" status: 200 len: 351 microversion: 2.1 time: 0.080363 Jul 25 12:16:05.889750 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 99/196] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:16:05 2022] GET /compute/v2.1/os-volumes/be3faca8-b427-4ae2-a288-5859b6823b04 => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:06.475787 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bc863bcd-bc99-4ff6-bc89-46f0aa9aeabf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:06.476691 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bc863bcd-bc99-4ff6-bc89-46f0aa9aeabf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:06.483356 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc863bcd-bc99-4ff6-bc89-46f0aa9aeabf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:06.484058 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc863bcd-bc99-4ff6-bc89-46f0aa9aeabf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:06.485030 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc863bcd-bc99-4ff6-bc89-46f0aa9aeabf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:06.485656 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc863bcd-bc99-4ff6-bc89-46f0aa9aeabf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:06.640334 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bc863bcd-bc99-4ff6-bc89-46f0aa9aeabf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:06.649021 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bc863bcd-bc99-4ff6-bc89-46f0aa9aeabf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.178442 Jul 25 12:16:06.649943 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 98/197] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:06 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:06.876271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1796cc35-202a-425d-b868-c1e67c0de844 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:06.877702 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1796cc35-202a-425d-b868-c1e67c0de844 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:06.884622 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1796cc35-202a-425d-b868-c1e67c0de844 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:06.885232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1796cc35-202a-425d-b868-c1e67c0de844 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:06.886183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1796cc35-202a-425d-b868-c1e67c0de844 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:06.886611 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1796cc35-202a-425d-b868-c1e67c0de844 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:07.031092 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1796cc35-202a-425d-b868-c1e67c0de844 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:07.041028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1796cc35-202a-425d-b868-c1e67c0de844 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1313 microversion: 2.1 time: 0.170648 Jul 25 12:16:07.042087 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 100/198] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:06 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:07.670946 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d0bfceac-6a7d-476b-b7ee-78d8b20a6261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:07.671780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d0bfceac-6a7d-476b-b7ee-78d8b20a6261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:07.679417 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d0bfceac-6a7d-476b-b7ee-78d8b20a6261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:07.680421 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d0bfceac-6a7d-476b-b7ee-78d8b20a6261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:07.681554 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d0bfceac-6a7d-476b-b7ee-78d8b20a6261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:07.682047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d0bfceac-6a7d-476b-b7ee-78d8b20a6261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:07.835059 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d0bfceac-6a7d-476b-b7ee-78d8b20a6261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:07.845879 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d0bfceac-6a7d-476b-b7ee-78d8b20a6261 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.179540 Jul 25 12:16:07.846625 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 99/199] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:07 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:08.062189 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-162037ab-29ec-474c-a1e8-8c9972d70afd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:08.062911 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-162037ab-29ec-474c-a1e8-8c9972d70afd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:08.071834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-162037ab-29ec-474c-a1e8-8c9972d70afd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:08.072867 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-162037ab-29ec-474c-a1e8-8c9972d70afd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:08.073801 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-162037ab-29ec-474c-a1e8-8c9972d70afd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:08.074393 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-162037ab-29ec-474c-a1e8-8c9972d70afd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:08.215944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-162037ab-29ec-474c-a1e8-8c9972d70afd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:08.224069 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-162037ab-29ec-474c-a1e8-8c9972d70afd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1313 microversion: 2.1 time: 0.165673 Jul 25 12:16:08.237613 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 101/200] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:08 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:08.867366 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-19bb8c21-3d46-4ac0-bdd5-8040646ed078 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:08.868793 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-19bb8c21-3d46-4ac0-bdd5-8040646ed078 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:08.876150 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19bb8c21-3d46-4ac0-bdd5-8040646ed078 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:08.876823 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19bb8c21-3d46-4ac0-bdd5-8040646ed078 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:08.877603 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19bb8c21-3d46-4ac0-bdd5-8040646ed078 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:08.878040 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19bb8c21-3d46-4ac0-bdd5-8040646ed078 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:09.017022 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-19bb8c21-3d46-4ac0-bdd5-8040646ed078 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:09.027213 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-19bb8c21-3d46-4ac0-bdd5-8040646ed078 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.163908 Jul 25 12:16:09.028013 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 100/201] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:08 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:09.233837 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7df59e1b-052b-4362-86ce-eacd3a0896f0 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Action: 'create', calling method: .version_select at 0x7f942c5b3a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1432640239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpbpH/dtu7d2ZrvGzjK7+t7Z2/dy3NnpAmHYqCqKWQ9QzSD/ctXYsNgwIiK79iursdKRilSnEjTny/u/VHayd2LEYB4493FosV1xoSic2E1D7hS99P5yV+dHXMr6fgoaw=="}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:09.245628 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-601d5544-4878-4c8e-9fd4-b0d3411ae7e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:09.247125 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-601d5544-4878-4c8e-9fd4-b0d3411ae7e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:09.249095 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-7df59e1b-052b-4362-86ce-eacd3a0896f0 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Getting quotas for project f63781e2ea3b43b48fc5a065fea7bad4. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:16:09.253467 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-7df59e1b-052b-4362-86ce-eacd3a0896f0 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Getting quotas for user 5ea6250801fc4f74b2180533687e8cf2 and project f63781e2ea3b43b48fc5a065fea7bad4. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:16:09.255169 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-601d5544-4878-4c8e-9fd4-b0d3411ae7e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:09.255760 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-601d5544-4878-4c8e-9fd4-b0d3411ae7e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:09.256659 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-601d5544-4878-4c8e-9fd4-b0d3411ae7e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:09.257222 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-601d5544-4878-4c8e-9fd4-b0d3411ae7e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:09.281829 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7df59e1b-052b-4362-86ce-eacd3a0896f0 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051614 Jul 25 12:16:09.291780 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 102/202] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Jul 25 12:16:09 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:09.392399 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-84da712a-b89f-4995-97e1-13910bfd3af6 req-9431dd82-6159-4816-a111-f1f913368b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ae1afa-6fd5-478b-8c01-6172efd19ee5", "name": "network-vif-plugged", "status": "completed", "tag": "29156948-b400-434f-ba82-bb5568519914"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:09.404713 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-84da712a-b89f-4995-97e1-13910bfd3af6 req-9431dd82-6159-4816-a111-f1f913368b4a service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:09.405362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-84da712a-b89f-4995-97e1-13910bfd3af6 req-9431dd82-6159-4816-a111-f1f913368b4a service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:09.406828 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-601d5544-4878-4c8e-9fd4-b0d3411ae7e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:09.415573 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-601d5544-4878-4c8e-9fd4-b0d3411ae7e3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1313 microversion: 2.1 time: 0.174918 Jul 25 12:16:09.416160 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 101/203] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:09 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:09.426266 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-84da712a-b89f-4995-97e1-13910bfd3af6 req-9431dd82-6159-4816-a111-f1f913368b4a service nova] Creating event network-vif-plugged:29156948-b400-434f-ba82-bb5568519914 for instance d6ae1afa-6fd5-478b-8c01-6172efd19ee5 on hv-cinder-79760 Jul 25 12:16:09.427581 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1859516465", "imageRef": "e0f96de5-17ba-40d9-a53c-b8a3ecf6cc3a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1432640239", "networks": [{"uuid": "1c19c869-ef0d-4854-ace3-e6594f309fd4"}]}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:09.432179 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-84da712a-b89f-4995-97e1-13910bfd3af6 req-9431dd82-6159-4816-a111-f1f913368b4a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044184 Jul 25 12:16:09.432889 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 103/204] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:09.488942 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] validate_networks() for [('1c19c869-ef0d-4854-ace3-e6594f309fd4', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:16:09.915435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:16:09.916035 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:16:09.916570 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:16:09.917097 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:16:09.923715 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:16:09.927213 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:09.927695 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:09.928489 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:09.928921 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:09.950801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Getting quotas for project f63781e2ea3b43b48fc5a065fea7bad4. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:16:09.955836 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Getting quotas for user 5ea6250801fc4f74b2180533687e8cf2 and project f63781e2ea3b43b48fc5a065fea7bad4. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:16:09.968468 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:16:09.970651 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0f96de5-17ba-40d9-a53c-b8a3ecf6cc3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:16:10.015930 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ae4dbc36-c700-4ce1-a85d-424e5b1ff797 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598414 Jul 25 12:16:10.016722 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 102/205] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:16:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:16:10.028099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b32ae906-c487-43af-b2a5-5131fea08491 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:10.028777 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b32ae906-c487-43af-b2a5-5131fea08491 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:10.049554 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-66465e55-77f7-45f1-91be-3872e13ce402 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:10.050158 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-66465e55-77f7-45f1-91be-3872e13ce402 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:10.061559 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-66465e55-77f7-45f1-91be-3872e13ce402 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:10.062060 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-66465e55-77f7-45f1-91be-3872e13ce402 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:10.063671 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-66465e55-77f7-45f1-91be-3872e13ce402 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:10.064131 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-66465e55-77f7-45f1-91be-3872e13ce402 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:10.138596 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b32ae906-c487-43af-b2a5-5131fea08491 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:10.147308 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b32ae906-c487-43af-b2a5-5131fea08491 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1259 microversion: 2.1 time: 0.123105 Jul 25 12:16:10.148392 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 104/206] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:10 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1259 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:10.219370 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-66465e55-77f7-45f1-91be-3872e13ce402 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:10.229376 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-66465e55-77f7-45f1-91be-3872e13ce402 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.184518 Jul 25 12:16:10.229966 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 103/207] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:10 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:10.436422 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1c907370-58cf-4bd7-8694-dae7e26de13a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:10.437032 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1c907370-58cf-4bd7-8694-dae7e26de13a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:10.443243 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c907370-58cf-4bd7-8694-dae7e26de13a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:10.445420 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c907370-58cf-4bd7-8694-dae7e26de13a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:10.446197 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c907370-58cf-4bd7-8694-dae7e26de13a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:10.446634 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c907370-58cf-4bd7-8694-dae7e26de13a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:10.527259 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ca8ac603-a173-4cf8-9d84-8ae880174b0e tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] Calling method '.version_select at 0x7f942c68e1f0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:10.582067 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ca8ac603-a173-4cf8-9d84-8ae880174b0e tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a7395c33-e518-442e-844f-03da2c4e79ba" status: 200 len: 351 microversion: 2.1 time: 0.058713 Jul 25 12:16:10.583610 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 104/208] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:16:10 2022] GET /compute/v2.1/os-volumes/a7395c33-e518-442e-844f-03da2c4e79ba => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:16:10.590895 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1c907370-58cf-4bd7-8694-dae7e26de13a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:10.599859 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1c907370-58cf-4bd7-8694-dae7e26de13a tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1313 microversion: 2.1 time: 0.167037 Jul 25 12:16:10.600855 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 105/209] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:10 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:11.167744 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5794e596-a530-44e2-888f-eb5b805c1e1b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:11.169011 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5794e596-a530-44e2-888f-eb5b805c1e1b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:11.175684 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5794e596-a530-44e2-888f-eb5b805c1e1b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:11.176762 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5794e596-a530-44e2-888f-eb5b805c1e1b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:11.177392 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5794e596-a530-44e2-888f-eb5b805c1e1b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:11.177827 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5794e596-a530-44e2-888f-eb5b805c1e1b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:11.240944 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5794e596-a530-44e2-888f-eb5b805c1e1b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:11.249402 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5794e596-a530-44e2-888f-eb5b805c1e1b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1311 microversion: 2.1 time: 0.086025 Jul 25 12:16:11.249962 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 105/210] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:11 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:11.250366 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b8be29a1-79a0-4abe-8fa7-5a09bcac7ad9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:11.251046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b8be29a1-79a0-4abe-8fa7-5a09bcac7ad9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:11.257676 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8be29a1-79a0-4abe-8fa7-5a09bcac7ad9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:11.258120 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8be29a1-79a0-4abe-8fa7-5a09bcac7ad9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:11.258871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8be29a1-79a0-4abe-8fa7-5a09bcac7ad9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:11.259296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8be29a1-79a0-4abe-8fa7-5a09bcac7ad9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:11.390295 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b8be29a1-79a0-4abe-8fa7-5a09bcac7ad9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:11.398100 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b8be29a1-79a0-4abe-8fa7-5a09bcac7ad9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.151642 Jul 25 12:16:11.398672 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 106/211] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:11 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:11.620919 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c7b8d3e3-d2a3-491b-9258-5fd744b0a817 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:11.621550 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c7b8d3e3-d2a3-491b-9258-5fd744b0a817 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:11.627611 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7b8d3e3-d2a3-491b-9258-5fd744b0a817 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:11.628063 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7b8d3e3-d2a3-491b-9258-5fd744b0a817 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:11.630860 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7b8d3e3-d2a3-491b-9258-5fd744b0a817 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:11.631305 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7b8d3e3-d2a3-491b-9258-5fd744b0a817 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:11.760994 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c7b8d3e3-d2a3-491b-9258-5fd744b0a817 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:11.768356 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c7b8d3e3-d2a3-491b-9258-5fd744b0a817 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1496 microversion: 2.1 time: 0.151378 Jul 25 12:16:11.768914 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 106/212] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:11 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1496 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:11.924344 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-86587d0d-f79b-48ce-b67a-3e8169246334 tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] Calling method '.version_select at 0x7f942c566ca0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:11.974312 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-86587d0d-f79b-48ce-b67a-3e8169246334 tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/030c513e-bf54-4482-b91e-415677dc947f" status: 200 len: 349 microversion: 2.1 time: 0.053602 Jul 25 12:16:11.975156 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 107/213] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:16:11 2022] GET /compute/v2.1/os-volumes/030c513e-bf54-4482-b91e-415677dc947f => generated 349 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:11.988574 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4f33c778-135c-4df6-936d-246ed8be4d51 tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] Calling method '.version_select at 0x7f942c51b550>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:12.072966 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4f33c778-135c-4df6-936d-246ed8be4d51 tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.088278 Jul 25 12:16:12.073533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 107/214] 10.222.0.42 () {58 vars in 1134 bytes} [Mon Jul 25 12:16:11 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:12.087571 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b1f0e805-71ae-421a-8ae6-0b3a791fa10a tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] Calling method '.version_select at 0x7f942c5660d0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:12.177160 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b1f0e805-71ae-421a-8ae6-0b3a791fa10a tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.093429 Jul 25 12:16:12.177723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 108/215] 10.222.0.42 () {58 vars in 1149 bytes} [Mon Jul 25 12:16:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:12.190993 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-72071465-4019-4802-89ce-83c0f531f33b tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] Calling method '.version_select at 0x7f942c588e50>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:12.271298 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2302db8f-dd72-49aa-a862-1cb1d221d470 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:12.271980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2302db8f-dd72-49aa-a862-1cb1d221d470 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:12.279864 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2302db8f-dd72-49aa-a862-1cb1d221d470 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:12.280012 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-72071465-4019-4802-89ce-83c0f531f33b tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092985 Jul 25 12:16:12.280322 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2302db8f-dd72-49aa-a862-1cb1d221d470 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:12.280911 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 108/216] 10.222.0.42 () {58 vars in 1134 bytes} [Mon Jul 25 12:16:12 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:12.284330 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2302db8f-dd72-49aa-a862-1cb1d221d470 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:12.284953 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2302db8f-dd72-49aa-a862-1cb1d221d470 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:12.293819 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8b0bd3c2-5876-4b7f-8b71-2e7df90148fd tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] Calling method '.version_select at 0x7f942c588790>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:12.353257 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2302db8f-dd72-49aa-a862-1cb1d221d470 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:12.361525 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2302db8f-dd72-49aa-a862-1cb1d221d470 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1311 microversion: 2.1 time: 0.094641 Jul 25 12:16:12.362173 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 109/217] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:12 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:12.370627 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4f163215-6a66-4a48-99a0-8b7c0da21666 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:12.372025 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4f163215-6a66-4a48-99a0-8b7c0da21666 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:12.378704 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f163215-6a66-4a48-99a0-8b7c0da21666 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:12.380060 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f163215-6a66-4a48-99a0-8b7c0da21666 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:12.380987 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f163215-6a66-4a48-99a0-8b7c0da21666 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:12.381523 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f163215-6a66-4a48-99a0-8b7c0da21666 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:12.406149 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8b0bd3c2-5876-4b7f-8b71-2e7df90148fd tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.115991 Jul 25 12:16:12.406716 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 109/218] 10.222.0.42 () {58 vars in 1167 bytes} [Mon Jul 25 12:16:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:12.410115 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4f163215-6a66-4a48-99a0-8b7c0da21666 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:16:12.419836 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a4da2fbd-230a-4882-b922-75968b0fc341 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:12.420529 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a4da2fbd-230a-4882-b922-75968b0fc341 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:12.427728 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4da2fbd-230a-4882-b922-75968b0fc341 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:12.428172 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4da2fbd-230a-4882-b922-75968b0fc341 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:12.428927 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4da2fbd-230a-4882-b922-75968b0fc341 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:12.429349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4da2fbd-230a-4882-b922-75968b0fc341 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:12.435299 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:12.503505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4f163215-6a66-4a48-99a0-8b7c0da21666 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 204 len: 0 microversion: 2.1 time: 0.137476 Jul 25 12:16:12.508762 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 110/219] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:16:12 2022] DELETE /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:16:12.514686 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7029a555-0f04-4207-8cfb-b9dd9148514b tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] Calling method '.version_select at 0x7f942c73c550>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:12.603779 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7029a555-0f04-4207-8cfb-b9dd9148514b tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.093381 Jul 25 12:16:12.604496 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 111/220] 10.222.0.42 () {58 vars in 1170 bytes} [Mon Jul 25 12:16:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:12.613261 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b21508b7-c6cf-41f5-b7b7-ae60d85d41a3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:12.613261 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b21508b7-c6cf-41f5-b7b7-ae60d85d41a3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:12.617493 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b21508b7-c6cf-41f5-b7b7-ae60d85d41a3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:12.617943 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b21508b7-c6cf-41f5-b7b7-ae60d85d41a3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:12.618710 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b21508b7-c6cf-41f5-b7b7-ae60d85d41a3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:12.619259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b21508b7-c6cf-41f5-b7b7-ae60d85d41a3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:12.635135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a4da2fbd-230a-4882-b922-75968b0fc341 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:12.642693 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a4da2fbd-230a-4882-b922-75968b0fc341 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.227444 Jul 25 12:16:12.643193 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 110/221] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:12 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:12.647855 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b7077ee3-5d97-438c-aa61-4e4a4f44f75a tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] Calling method '.version_select at 0x7f942c800af0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:12.731236 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b7077ee3-5d97-438c-aa61-4e4a4f44f75a tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086983 Jul 25 12:16:12.731837 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 111/222] 10.222.0.42 () {58 vars in 1155 bytes} [Mon Jul 25 12:16:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:12.744728 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e6247ae0-8d65-48fa-af46-38f6ff5f8d76 tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] Calling method '.version_select at 0x7f942c5205e0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:12.749343 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b21508b7-c6cf-41f5-b7b7-ae60d85d41a3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:12.758019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b21508b7-c6cf-41f5-b7b7-ae60d85d41a3 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1502 microversion: 2.1 time: 0.152433 Jul 25 12:16:12.758892 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 112/223] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:12 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:12.831134 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e6247ae0-8d65-48fa-af46-38f6ff5f8d76 tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089956 Jul 25 12:16:12.831742 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 112/224] 10.222.0.42 () {58 vars in 1188 bytes} [Mon Jul 25 12:16:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:16:12.844221 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ed6b99b4-d331-4a01-9d2e-6fe7e5ee3646 tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] Calling method '.version_select at 0x7f942c566dc0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:12.924275 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ed6b99b4-d331-4a01-9d2e-6fe7e5ee3646 tempest-VolumesTestJSON-1876715914 tempest-VolumesTestJSON-1876715914-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083665 Jul 25 12:16:12.924849 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 113/225] 10.222.0.42 () {58 vars in 1155 bytes} [Mon Jul 25 12:16:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:13.383142 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8c14c35b-a368-41c0-a36a-c8909ffb846d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:13.383826 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8c14c35b-a368-41c0-a36a-c8909ffb846d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:13.389805 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c14c35b-a368-41c0-a36a-c8909ffb846d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:13.390244 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c14c35b-a368-41c0-a36a-c8909ffb846d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:13.390983 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c14c35b-a368-41c0-a36a-c8909ffb846d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:13.391410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8c14c35b-a368-41c0-a36a-c8909ffb846d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:13.454367 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8c14c35b-a368-41c0-a36a-c8909ffb846d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:13.462334 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8c14c35b-a368-41c0-a36a-c8909ffb846d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1317 microversion: 2.1 time: 0.084047 Jul 25 12:16:13.462952 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 113/226] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:13 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1317 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:13.664723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8caa24af-c80b-4dbe-b2b6-b51f86b1e31a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:13.665257 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8caa24af-c80b-4dbe-b2b6-b51f86b1e31a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:13.671371 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8caa24af-c80b-4dbe-b2b6-b51f86b1e31a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:13.671855 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8caa24af-c80b-4dbe-b2b6-b51f86b1e31a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:13.672615 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8caa24af-c80b-4dbe-b2b6-b51f86b1e31a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:13.673052 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8caa24af-c80b-4dbe-b2b6-b51f86b1e31a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:13.781105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4041c1a7-46d7-4491-b106-4a96b66cbebe tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:13.781881 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4041c1a7-46d7-4491-b106-4a96b66cbebe tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:13.788223 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4041c1a7-46d7-4491-b106-4a96b66cbebe tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:13.788740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4041c1a7-46d7-4491-b106-4a96b66cbebe tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:13.789565 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4041c1a7-46d7-4491-b106-4a96b66cbebe tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:13.790063 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4041c1a7-46d7-4491-b106-4a96b66cbebe tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:13.800133 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8caa24af-c80b-4dbe-b2b6-b51f86b1e31a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:13.807511 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8caa24af-c80b-4dbe-b2b6-b51f86b1e31a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.147318 Jul 25 12:16:13.808111 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 114/227] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:13 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:13.920681 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4041c1a7-46d7-4491-b106-4a96b66cbebe tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:13.928613 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4041c1a7-46d7-4491-b106-4a96b66cbebe tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1502 microversion: 2.1 time: 0.152040 Jul 25 12:16:13.929189 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 114/228] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:13 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:14.486316 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a5de7303-f79a-47d5-a93e-84c560a45151 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:14.489354 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a5de7303-f79a-47d5-a93e-84c560a45151 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:14.497646 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a5de7303-f79a-47d5-a93e-84c560a45151 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:14.498781 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a5de7303-f79a-47d5-a93e-84c560a45151 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:14.499930 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a5de7303-f79a-47d5-a93e-84c560a45151 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:14.500517 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a5de7303-f79a-47d5-a93e-84c560a45151 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:14.573120 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a5de7303-f79a-47d5-a93e-84c560a45151 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:14.582069 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a5de7303-f79a-47d5-a93e-84c560a45151 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1317 microversion: 2.1 time: 0.101869 Jul 25 12:16:14.583346 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 115/229] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:14 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1317 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:14.830311 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e90a271a-d2c5-4c7d-90f2-c9d79524da7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:14.830971 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e90a271a-d2c5-4c7d-90f2-c9d79524da7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:14.855086 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e90a271a-d2c5-4c7d-90f2-c9d79524da7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:14.855568 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e90a271a-d2c5-4c7d-90f2-c9d79524da7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:14.856376 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e90a271a-d2c5-4c7d-90f2-c9d79524da7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:14.856811 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e90a271a-d2c5-4c7d-90f2-c9d79524da7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:14.952259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7f561bcf-9217-4750-8da4-17e9a710d422 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:14.953033 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7f561bcf-9217-4750-8da4-17e9a710d422 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:14.964511 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f561bcf-9217-4750-8da4-17e9a710d422 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:14.966025 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f561bcf-9217-4750-8da4-17e9a710d422 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:14.967535 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f561bcf-9217-4750-8da4-17e9a710d422 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:14.968312 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f561bcf-9217-4750-8da4-17e9a710d422 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:15.262530 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7f561bcf-9217-4750-8da4-17e9a710d422 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:15.270837 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7f561bcf-9217-4750-8da4-17e9a710d422 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1502 microversion: 2.1 time: 0.324361 Jul 25 12:16:15.282601 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 116/230] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:14 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1502 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:15.557295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e90a271a-d2c5-4c7d-90f2-c9d79524da7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:15.569973 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e90a271a-d2c5-4c7d-90f2-c9d79524da7b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.743860 Jul 25 12:16:15.572163 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 115/231] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:14 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:15.605849 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b409ae14-447c-4956-9892-4dc1fc94bea5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:15.606468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b409ae14-447c-4956-9892-4dc1fc94bea5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:15.618433 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b409ae14-447c-4956-9892-4dc1fc94bea5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:15.618920 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b409ae14-447c-4956-9892-4dc1fc94bea5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:15.621290 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b409ae14-447c-4956-9892-4dc1fc94bea5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:15.623384 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b409ae14-447c-4956-9892-4dc1fc94bea5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:15.900786 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b409ae14-447c-4956-9892-4dc1fc94bea5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:15.911155 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-319741ec-c3e3-430c-92ae-39d40269f2be req-41403763-1b66-4999-9db2-3c71d1afe137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ae1afa-6fd5-478b-8c01-6172efd19ee5", "name": "network-vif-deleted", "tag": "29156948-b400-434f-ba82-bb5568519914"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:15.913159 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b409ae14-447c-4956-9892-4dc1fc94bea5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.310920 Jul 25 12:16:15.916013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 117/232] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:15 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:15.943262 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-319741ec-c3e3-430c-92ae-39d40269f2be req-41403763-1b66-4999-9db2-3c71d1afe137 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:15.943730 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-319741ec-c3e3-430c-92ae-39d40269f2be req-41403763-1b66-4999-9db2-3c71d1afe137 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:15.978432 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-319741ec-c3e3-430c-92ae-39d40269f2be req-41403763-1b66-4999-9db2-3c71d1afe137 service nova] Creating event network-vif-deleted:29156948-b400-434f-ba82-bb5568519914 for instance d6ae1afa-6fd5-478b-8c01-6172efd19ee5 on hv-cinder-79760 Jul 25 12:16:15.984528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-319741ec-c3e3-430c-92ae-39d40269f2be req-41403763-1b66-4999-9db2-3c71d1afe137 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077918 Jul 25 12:16:15.985990 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 116/233] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:16.296315 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1c4223ea-1aa4-4251-82ae-d9d8e74ab4ac tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:16.296954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1c4223ea-1aa4-4251-82ae-d9d8e74ab4ac tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:16.303875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c4223ea-1aa4-4251-82ae-d9d8e74ab4ac tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:16.304642 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c4223ea-1aa4-4251-82ae-d9d8e74ab4ac tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:16.305693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c4223ea-1aa4-4251-82ae-d9d8e74ab4ac tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:16.306340 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c4223ea-1aa4-4251-82ae-d9d8e74ab4ac tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:16.395376 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1c4223ea-1aa4-4251-82ae-d9d8e74ab4ac tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:16.405202 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1c4223ea-1aa4-4251-82ae-d9d8e74ab4ac tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1460 microversion: 2.1 time: 0.112761 Jul 25 12:16:16.406100 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 118/234] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:16 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1460 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:16.593515 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bdd0d87d-2342-4bc6-a22f-e18c4bcb3a28 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:16.594460 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bdd0d87d-2342-4bc6-a22f-e18c4bcb3a28 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:16.628220 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdd0d87d-2342-4bc6-a22f-e18c4bcb3a28 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:16.628650 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdd0d87d-2342-4bc6-a22f-e18c4bcb3a28 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:16.635844 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdd0d87d-2342-4bc6-a22f-e18c4bcb3a28 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:16.636691 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bdd0d87d-2342-4bc6-a22f-e18c4bcb3a28 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:16.942909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d1a3ea34-3154-4505-9493-4a0f11843462 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:16.947750 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d1a3ea34-3154-4505-9493-4a0f11843462 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:16.981944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1a3ea34-3154-4505-9493-4a0f11843462 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:16.984171 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1a3ea34-3154-4505-9493-4a0f11843462 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:16.989510 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1a3ea34-3154-4505-9493-4a0f11843462 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:16.991050 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1a3ea34-3154-4505-9493-4a0f11843462 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:17.187247 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bdd0d87d-2342-4bc6-a22f-e18c4bcb3a28 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:17.195977 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bdd0d87d-2342-4bc6-a22f-e18c4bcb3a28 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.606729 Jul 25 12:16:17.196494 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 117/235] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:16 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:17.233885 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d1a3ea34-3154-4505-9493-4a0f11843462 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:17.243844 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d1a3ea34-3154-4505-9493-4a0f11843462 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.307164 Jul 25 12:16:17.244914 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 119/236] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:16 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:17.433768 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6bdc9e85-db7e-4503-94d4-b068c9907434 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:17.434724 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6bdc9e85-db7e-4503-94d4-b068c9907434 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:17.449717 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:17.453979 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bdc9e85-db7e-4503-94d4-b068c9907434 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:17.456724 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bdc9e85-db7e-4503-94d4-b068c9907434 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:17.458222 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bdc9e85-db7e-4503-94d4-b068c9907434 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:17.458683 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6bdc9e85-db7e-4503-94d4-b068c9907434 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:17.481019 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:17.672042 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6bdc9e85-db7e-4503-94d4-b068c9907434 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:17.682531 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6bdc9e85-db7e-4503-94d4-b068c9907434 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1460 microversion: 2.1 time: 0.254024 Jul 25 12:16:17.689335 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 118/237] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:17 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1460 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:18.008590 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-24c6c30c-9768-4b0d-8cf6-c2c38c4d0b83 req-1deeb303-b7a4-485e-b06f-a1b2aebe6a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6facc5-40af-42cb-80fe-268e5a380a6b", "tag": "18e2de81-a509-4850-99c1-f87dfe2e51c2"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:18.023608 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-24c6c30c-9768-4b0d-8cf6-c2c38c4d0b83 req-1deeb303-b7a4-485e-b06f-a1b2aebe6a04 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:18.024868 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-24c6c30c-9768-4b0d-8cf6-c2c38c4d0b83 req-1deeb303-b7a4-485e-b06f-a1b2aebe6a04 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:18.038843 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-24c6c30c-9768-4b0d-8cf6-c2c38c4d0b83 req-1deeb303-b7a4-485e-b06f-a1b2aebe6a04 service nova] Creating event network-changed:18e2de81-a509-4850-99c1-f87dfe2e51c2 for instance 5d6facc5-40af-42cb-80fe-268e5a380a6b on hv-cinder-79760 Jul 25 12:16:18.044208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-24c6c30c-9768-4b0d-8cf6-c2c38c4d0b83 req-1deeb303-b7a4-485e-b06f-a1b2aebe6a04 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039761 Jul 25 12:16:18.045284 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 120/238] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:18.223560 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cff5d52a-77f6-4092-8d57-8e013472e600 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:18.224300 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cff5d52a-77f6-4092-8d57-8e013472e600 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:18.240768 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cff5d52a-77f6-4092-8d57-8e013472e600 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:18.241579 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cff5d52a-77f6-4092-8d57-8e013472e600 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:18.242838 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cff5d52a-77f6-4092-8d57-8e013472e600 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:18.243272 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cff5d52a-77f6-4092-8d57-8e013472e600 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:18.272878 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-640388d6-0fc1-4556-bf58-134597e78b7a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:18.273894 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-640388d6-0fc1-4556-bf58-134597e78b7a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:18.280643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-640388d6-0fc1-4556-bf58-134597e78b7a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:18.281377 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-640388d6-0fc1-4556-bf58-134597e78b7a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:18.282482 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-640388d6-0fc1-4556-bf58-134597e78b7a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:18.283096 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-640388d6-0fc1-4556-bf58-134597e78b7a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:18.482123 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cff5d52a-77f6-4092-8d57-8e013472e600 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:18.492861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cff5d52a-77f6-4092-8d57-8e013472e600 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.273869 Jul 25 12:16:18.494482 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 119/239] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:18 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:18.575579 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-640388d6-0fc1-4556-bf58-134597e78b7a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:18.584543 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-640388d6-0fc1-4556-bf58-134597e78b7a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.316174 Jul 25 12:16:18.585567 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 121/240] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:18 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:18.714044 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-198073a0-7d21-4fad-a6ce-30f79981e27b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:18.715074 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-198073a0-7d21-4fad-a6ce-30f79981e27b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:18.726875 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-198073a0-7d21-4fad-a6ce-30f79981e27b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:18.727785 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-198073a0-7d21-4fad-a6ce-30f79981e27b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:18.728738 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-198073a0-7d21-4fad-a6ce-30f79981e27b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:18.729327 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-198073a0-7d21-4fad-a6ce-30f79981e27b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:18.817817 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-198073a0-7d21-4fad-a6ce-30f79981e27b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:18.833559 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-198073a0-7d21-4fad-a6ce-30f79981e27b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1460 microversion: 2.1 time: 0.124611 Jul 25 12:16:18.835473 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 120/241] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:18 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1460 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:19.536968 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-27a8e3d1-203c-4702-a7c0-36207aef6d02 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:19.537656 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-27a8e3d1-203c-4702-a7c0-36207aef6d02 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:19.544323 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27a8e3d1-203c-4702-a7c0-36207aef6d02 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:19.545178 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27a8e3d1-203c-4702-a7c0-36207aef6d02 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:19.546371 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27a8e3d1-203c-4702-a7c0-36207aef6d02 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:19.546809 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-27a8e3d1-203c-4702-a7c0-36207aef6d02 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:19.609668 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4117338e-aec4-49b9-a229-b3d689d10d76 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:19.611011 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4117338e-aec4-49b9-a229-b3d689d10d76 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:19.630676 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4117338e-aec4-49b9-a229-b3d689d10d76 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:19.631396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4117338e-aec4-49b9-a229-b3d689d10d76 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:19.632476 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4117338e-aec4-49b9-a229-b3d689d10d76 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:19.633050 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4117338e-aec4-49b9-a229-b3d689d10d76 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:19.748873 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-27a8e3d1-203c-4702-a7c0-36207aef6d02 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:19.757562 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-27a8e3d1-203c-4702-a7c0-36207aef6d02 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.225400 Jul 25 12:16:19.758517 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 122/242] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:19 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:19.859852 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7f514a91-2dd0-4e51-a97c-cdce82d01068 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:19.860782 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7f514a91-2dd0-4e51-a97c-cdce82d01068 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:19.868455 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4117338e-aec4-49b9-a229-b3d689d10d76 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:19.876992 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4117338e-aec4-49b9-a229-b3d689d10d76 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.271920 Jul 25 12:16:19.880479 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f514a91-2dd0-4e51-a97c-cdce82d01068 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:19.881294 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 121/243] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:19 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:19.881959 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f514a91-2dd0-4e51-a97c-cdce82d01068 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:19.883256 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f514a91-2dd0-4e51-a97c-cdce82d01068 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:19.883883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f514a91-2dd0-4e51-a97c-cdce82d01068 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:19.972220 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7f514a91-2dd0-4e51-a97c-cdce82d01068 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:19.981284 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7f514a91-2dd0-4e51-a97c-cdce82d01068 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1460 microversion: 2.1 time: 0.125068 Jul 25 12:16:19.996576 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 123/244] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:19 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1460 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:20.782749 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9fd91e15-a01c-4157-8253-a24eb7e31aa2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:20.788850 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9fd91e15-a01c-4157-8253-a24eb7e31aa2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:20.792970 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:20.794149 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:20.799226 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fd91e15-a01c-4157-8253-a24eb7e31aa2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:20.799710 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fd91e15-a01c-4157-8253-a24eb7e31aa2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:20.800492 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fd91e15-a01c-4157-8253-a24eb7e31aa2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:20.801585 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fd91e15-a01c-4157-8253-a24eb7e31aa2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:20.901616 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-85247a32-1629-4553-8b37-37123f6a106e tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:20.902224 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-85247a32-1629-4553-8b37-37123f6a106e tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:20.904255 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:20.910384 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85247a32-1629-4553-8b37-37123f6a106e tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:20.911574 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85247a32-1629-4553-8b37-37123f6a106e tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:20.912539 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85247a32-1629-4553-8b37-37123f6a106e tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:20.922271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85247a32-1629-4553-8b37-37123f6a106e tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:20.952227 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9fd91e15-a01c-4157-8253-a24eb7e31aa2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:20.961354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9fd91e15-a01c-4157-8253-a24eb7e31aa2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.182686 Jul 25 12:16:20.973203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 122/245] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:20 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:21.004309 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dcd6261f-391b-462b-ba27-5347ed5af732 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:21.004920 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dcd6261f-391b-462b-ba27-5347ed5af732 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:21.011445 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dcd6261f-391b-462b-ba27-5347ed5af732 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:21.011927 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dcd6261f-391b-462b-ba27-5347ed5af732 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:21.012691 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dcd6261f-391b-462b-ba27-5347ed5af732 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:21.013116 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dcd6261f-391b-462b-ba27-5347ed5af732 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:21.086037 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dcd6261f-391b-462b-ba27-5347ed5af732 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:21.096417 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dcd6261f-391b-462b-ba27-5347ed5af732 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1460 microversion: 2.1 time: 0.094557 Jul 25 12:16:21.115482 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 123/246] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:20 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1460 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:21.133976 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-85247a32-1629-4553-8b37-37123f6a106e tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:21.148795 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-85247a32-1629-4553-8b37-37123f6a106e tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.250717 Jul 25 12:16:21.149494 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 124/247] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:20 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:21.983717 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9d9ad22d-b7c7-4a24-9d22-7f29a154a505 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:21.984374 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9d9ad22d-b7c7-4a24-9d22-7f29a154a505 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:21.992915 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d9ad22d-b7c7-4a24-9d22-7f29a154a505 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:21.993483 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d9ad22d-b7c7-4a24-9d22-7f29a154a505 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:21.994413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d9ad22d-b7c7-4a24-9d22-7f29a154a505 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:21.994916 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9d9ad22d-b7c7-4a24-9d22-7f29a154a505 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:22.138247 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-98198301-06f4-4642-86d8-1411d37421cd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:22.139582 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-98198301-06f4-4642-86d8-1411d37421cd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:22.147737 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9d9ad22d-b7c7-4a24-9d22-7f29a154a505 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:22.150572 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98198301-06f4-4642-86d8-1411d37421cd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:22.151029 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98198301-06f4-4642-86d8-1411d37421cd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:22.152487 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98198301-06f4-4642-86d8-1411d37421cd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:22.152934 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98198301-06f4-4642-86d8-1411d37421cd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:22.156780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9d9ad22d-b7c7-4a24-9d22-7f29a154a505 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.176991 Jul 25 12:16:22.167964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 124/248] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:21 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:22.179012 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e856b679-760d-409d-8930-00a6e9f4b593 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:22.181017 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e856b679-760d-409d-8930-00a6e9f4b593 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:22.190335 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e856b679-760d-409d-8930-00a6e9f4b593 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:22.192232 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e856b679-760d-409d-8930-00a6e9f4b593 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:22.193319 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e856b679-760d-409d-8930-00a6e9f4b593 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:22.193984 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e856b679-760d-409d-8930-00a6e9f4b593 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:22.251505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-98198301-06f4-4642-86d8-1411d37421cd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:22.262924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-98198301-06f4-4642-86d8-1411d37421cd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1460 microversion: 2.1 time: 0.128668 Jul 25 12:16:22.277180 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 125/249] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:22 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1460 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:22.382381 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e856b679-760d-409d-8930-00a6e9f4b593 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:22.390731 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e856b679-760d-409d-8930-00a6e9f4b593 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.216048 Jul 25 12:16:22.391636 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 125/250] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:22 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:23.180658 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-16bfa939-2511-45c3-84d6-52c93fa83ad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:23.181279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-16bfa939-2511-45c3-84d6-52c93fa83ad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:23.187202 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16bfa939-2511-45c3-84d6-52c93fa83ad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:23.187705 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16bfa939-2511-45c3-84d6-52c93fa83ad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:23.188470 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16bfa939-2511-45c3-84d6-52c93fa83ad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:23.188902 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16bfa939-2511-45c3-84d6-52c93fa83ad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:23.289871 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9f2c579c-93c3-409d-b44c-c2da4c500311 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:23.291086 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9f2c579c-93c3-409d-b44c-c2da4c500311 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:23.297892 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f2c579c-93c3-409d-b44c-c2da4c500311 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:23.298564 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f2c579c-93c3-409d-b44c-c2da4c500311 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:23.299484 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f2c579c-93c3-409d-b44c-c2da4c500311 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:23.300088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9f2c579c-93c3-409d-b44c-c2da4c500311 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:23.329349 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-16bfa939-2511-45c3-84d6-52c93fa83ad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:23.338338 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-16bfa939-2511-45c3-84d6-52c93fa83ad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.162817 Jul 25 12:16:23.352430 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 126/251] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:23 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:23.412289 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-66b4ef47-dd56-4ee6-a379-30ac82ac935b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:23.413085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-66b4ef47-dd56-4ee6-a379-30ac82ac935b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:23.414015 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9f2c579c-93c3-409d-b44c-c2da4c500311 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:23.420407 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66b4ef47-dd56-4ee6-a379-30ac82ac935b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:23.421225 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66b4ef47-dd56-4ee6-a379-30ac82ac935b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:23.422284 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66b4ef47-dd56-4ee6-a379-30ac82ac935b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:23.422886 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66b4ef47-dd56-4ee6-a379-30ac82ac935b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:23.431528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9f2c579c-93c3-409d-b44c-c2da4c500311 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1298 microversion: 2.1 time: 0.145308 Jul 25 12:16:23.432991 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 126/252] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:23 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1298 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:23.576057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-66b4ef47-dd56-4ee6-a379-30ac82ac935b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:23.583602 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-66b4ef47-dd56-4ee6-a379-30ac82ac935b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.175654 Jul 25 12:16:23.584188 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 127/253] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:23 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:24.359070 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a530a348-b517-42ae-a392-2dcee0dddf13 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:24.359650 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a530a348-b517-42ae-a392-2dcee0dddf13 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:24.366043 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a530a348-b517-42ae-a392-2dcee0dddf13 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:24.366487 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a530a348-b517-42ae-a392-2dcee0dddf13 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:24.367231 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a530a348-b517-42ae-a392-2dcee0dddf13 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:24.367689 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a530a348-b517-42ae-a392-2dcee0dddf13 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:24.453876 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b5af97dd-2d08-480f-b054-1d3ff1fbe5dd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:24.454492 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b5af97dd-2d08-480f-b054-1d3ff1fbe5dd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:24.461071 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5af97dd-2d08-480f-b054-1d3ff1fbe5dd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:24.461698 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5af97dd-2d08-480f-b054-1d3ff1fbe5dd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:24.462801 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5af97dd-2d08-480f-b054-1d3ff1fbe5dd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:24.463387 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5af97dd-2d08-480f-b054-1d3ff1fbe5dd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:24.494906 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5af97dd-2d08-480f-b054-1d3ff1fbe5dd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:24.495360 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5af97dd-2d08-480f-b054-1d3ff1fbe5dd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:24.495836 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-b5af97dd-2d08-480f-b054-1d3ff1fbe5dd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lazy-loading 'fault' on Instance uuid d6ae1afa-6fd5-478b-8c01-6172efd19ee5 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:16:24.498566 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:24.505609 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a530a348-b517-42ae-a392-2dcee0dddf13 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:24.514179 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a530a348-b517-42ae-a392-2dcee0dddf13 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.158866 Jul 25 12:16:24.514747 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 127/254] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:24 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:24.550907 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b5af97dd-2d08-480f-b054-1d3ff1fbe5dd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:24.558465 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b5af97dd-2d08-480f-b054-1d3ff1fbe5dd tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 200 len: 1303 microversion: 2.1 time: 0.108777 Jul 25 12:16:24.559349 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 128/255] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:24 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:24.605250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cdb56617-e220-464a-a52a-7c031dc9716f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:24.605860 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cdb56617-e220-464a-a52a-7c031dc9716f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:24.611832 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cdb56617-e220-464a-a52a-7c031dc9716f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:24.612278 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cdb56617-e220-464a-a52a-7c031dc9716f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:24.613558 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cdb56617-e220-464a-a52a-7c031dc9716f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:24.613989 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cdb56617-e220-464a-a52a-7c031dc9716f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:24.750257 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cdb56617-e220-464a-a52a-7c031dc9716f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:24.758318 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cdb56617-e220-464a-a52a-7c031dc9716f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.156890 Jul 25 12:16:24.758862 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 128/256] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:24 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:25.537299 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d27df41f-a6b1-491c-becc-41864cff13c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:25.537894 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d27df41f-a6b1-491c-becc-41864cff13c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:25.543954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d27df41f-a6b1-491c-becc-41864cff13c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:25.544395 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d27df41f-a6b1-491c-becc-41864cff13c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:25.546493 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d27df41f-a6b1-491c-becc-41864cff13c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:25.546493 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d27df41f-a6b1-491c-becc-41864cff13c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:25.582113 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dcf814a5-1a3b-41f5-aaec-9f18ddfb2283 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:25.582955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dcf814a5-1a3b-41f5-aaec-9f18ddfb2283 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: d6ae1afa-6fd5-478b-8c01-6172efd19ee5] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:25.590698 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dcf814a5-1a3b-41f5-aaec-9f18ddfb2283 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:25.591418 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dcf814a5-1a3b-41f5-aaec-9f18ddfb2283 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:25.592303 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dcf814a5-1a3b-41f5-aaec-9f18ddfb2283 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:25.593505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dcf814a5-1a3b-41f5-aaec-9f18ddfb2283 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:25.610251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-dcf814a5-1a3b-41f5-aaec-9f18ddfb2283 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] HTTP exception thrown: Instance d6ae1afa-6fd5-478b-8c01-6172efd19ee5 could not be found. Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dcf814a5-1a3b-41f5-aaec-9f18ddfb2283 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Request method failure captured: Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 HTTP/1.1 Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3olw-k1OPFMSXEbgHxFS-hvCdP-t5TIh5a-x6mmshdB09W3Z4PNNYJcGhv-I3yWqYJ_p9B7rTmVQwry_RvBW192p3NWl0cPuqrW5xYUdB5QNW9e5eMB03Bwg3d_9m_qXSgRFSOm-hk_BUBd1gCVC3x3kerzDQjYxflUl9sPptBkexlE Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 91bd04f2c9d34640ab6317fc8dd3dddb Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesActionsTest-308493614 Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:16:25.611939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:16:25.613458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91bd04f2c9d34640ab6317fc8dd3dddb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91bd04f2c9d34640ab6317fc8dd3dddb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_91bd04f2c9d34640ab6317fc8dd3dddb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/91bd04f2c9d34640ab6317fc8dd3dddb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:16:25.613458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesActionsTest-308493614 Jul 25 12:16:25.613458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 91bd04f2c9d34640ab6317fc8dd3dddb Jul 25 12:16:25.613458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesActionsTest-308493614 Jul 25 12:16:25.613458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesActionsTest-308493614-project Jul 25 12:16:25.613458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:16:25.613458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:16:25.613458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 5f696b65c8094119af332e7e837b888e Jul 25 12:16:25.613458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesActionsTest-308493614-project Jul 25 12:16:25.613458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:16:25.613458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance d6ae1afa-6fd5-478b-8c01-6172efd19ee5 could not be found. Jul 25 12:16:25.613458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': 'd6ae1afa-6fd5-478b-8c01-6172efd19ee5'} Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6ae1afa-6fd5-478b-8c01-6172efd19ee5 could not be found. Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:16:25.614279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6ae1afa-6fd5-478b-8c01-6172efd19ee5 could not be found. Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6ae1afa-6fd5-478b-8c01-6172efd19ee5 could not be found. Jul 25 12:16:25.615635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:16:25.616799 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dcf814a5-1a3b-41f5-aaec-9f18ddfb2283 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Returning 404 to user: Instance d6ae1afa-6fd5-478b-8c01-6172efd19ee5 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:16:25.616799 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dcf814a5-1a3b-41f5-aaec-9f18ddfb2283 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5" status: 404 len: 111 microversion: 2.1 time: 0.035920 Jul 25 12:16:25.617218 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 129/257] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:25 2022] GET /compute/v2.1/servers/d6ae1afa-6fd5-478b-8c01-6172efd19ee5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:16:25.709006 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d27df41f-a6b1-491c-becc-41864cff13c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:25.719471 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d27df41f-a6b1-491c-becc-41864cff13c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.186490 Jul 25 12:16:25.721078 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 129/258] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:25 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:25.744436 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-655404397", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "networks": [{"uuid": "c68dde59-1544-4fd3-8e4e-babe3594a8bb"}]}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:25.778265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c6543885-f87a-42d6-994e-959748a11192 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:25.778869 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c6543885-f87a-42d6-994e-959748a11192 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:25.786053 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c6543885-f87a-42d6-994e-959748a11192 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:25.786495 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c6543885-f87a-42d6-994e-959748a11192 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:25.787250 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c6543885-f87a-42d6-994e-959748a11192 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:25.787707 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c6543885-f87a-42d6-994e-959748a11192 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:25.811350 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] validate_networks() for [('c68dde59-1544-4fd3-8e4e-babe3594a8bb', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:16:25.935783 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c6543885-f87a-42d6-994e-959748a11192 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:25.945057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c6543885-f87a-42d6-994e-959748a11192 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.170498 Jul 25 12:16:25.945550 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 130/259] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:25 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:26.193133 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:16:26.193551 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:16:26.194019 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:16:26.194424 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:16:26.194829 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:16:26.204169 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:26.204678 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:26.205529 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:26.206024 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:26.223786 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Getting quotas for project 91bd04f2c9d34640ab6317fc8dd3dddb. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:16:26.227818 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Getting quotas for user 5f696b65c8094119af332e7e837b888e and project 91bd04f2c9d34640ab6317fc8dd3dddb. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:16:26.238995 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:16:26.241402 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:16:26.302404 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ed7772e9-13d4-4bc6-a81c-69311b414742 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561380 Jul 25 12:16:26.303020 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 130/260] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:16:26.313844 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7d648d2a-e673-4034-a341-7ce2b960e2e2 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:26.314447 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7d648d2a-e673-4034-a341-7ce2b960e2e2 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:26.373756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7d648d2a-e673-4034-a341-7ce2b960e2e2 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:26.381828 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7d648d2a-e673-4034-a341-7ce2b960e2e2 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1213 microversion: 2.1 time: 0.071502 Jul 25 12:16:26.382568 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 131/261] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:26 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:26.743917 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5e5034dd-ff95-449f-9176-f08466b3b875 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:26.744539 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5e5034dd-ff95-449f-9176-f08466b3b875 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:26.751207 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e5034dd-ff95-449f-9176-f08466b3b875 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:26.751699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e5034dd-ff95-449f-9176-f08466b3b875 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:26.752462 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e5034dd-ff95-449f-9176-f08466b3b875 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:26.752894 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5e5034dd-ff95-449f-9176-f08466b3b875 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:26.926855 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5e5034dd-ff95-449f-9176-f08466b3b875 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:26.934601 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5e5034dd-ff95-449f-9176-f08466b3b875 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.195771 Jul 25 12:16:26.935277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 131/262] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:26 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:26.965090 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c8bdbb0d-74ec-40da-8ef5-d89f9d4e7d40 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:26.965690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c8bdbb0d-74ec-40da-8ef5-d89f9d4e7d40 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:26.971839 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8bdbb0d-74ec-40da-8ef5-d89f9d4e7d40 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:26.973075 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8bdbb0d-74ec-40da-8ef5-d89f9d4e7d40 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:26.973836 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8bdbb0d-74ec-40da-8ef5-d89f9d4e7d40 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:26.974267 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c8bdbb0d-74ec-40da-8ef5-d89f9d4e7d40 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:27.103581 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c8bdbb0d-74ec-40da-8ef5-d89f9d4e7d40 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:27.110921 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c8bdbb0d-74ec-40da-8ef5-d89f9d4e7d40 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.149562 Jul 25 12:16:27.111566 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 132/263] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:26 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:27.404333 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d94f5fdc-c4c3-4379-bdc7-b348e0b1f36e tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:27.404789 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d94f5fdc-c4c3-4379-bdc7-b348e0b1f36e tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:27.415948 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d94f5fdc-c4c3-4379-bdc7-b348e0b1f36e tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:27.416655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d94f5fdc-c4c3-4379-bdc7-b348e0b1f36e tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:27.417606 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d94f5fdc-c4c3-4379-bdc7-b348e0b1f36e tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:27.418447 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d94f5fdc-c4c3-4379-bdc7-b348e0b1f36e tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:27.497749 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d94f5fdc-c4c3-4379-bdc7-b348e0b1f36e tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:27.507952 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d94f5fdc-c4c3-4379-bdc7-b348e0b1f36e tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1265 microversion: 2.1 time: 0.109040 Jul 25 12:16:27.508818 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 132/264] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:27 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:27.955776 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3e80ead5-2861-44fb-a195-cf3107ca1fb7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:27.957097 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3e80ead5-2861-44fb-a195-cf3107ca1fb7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:27.963188 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e80ead5-2861-44fb-a195-cf3107ca1fb7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:27.963738 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e80ead5-2861-44fb-a195-cf3107ca1fb7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:27.964585 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e80ead5-2861-44fb-a195-cf3107ca1fb7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:27.965076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3e80ead5-2861-44fb-a195-cf3107ca1fb7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:28.103103 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3e80ead5-2861-44fb-a195-cf3107ca1fb7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:28.118475 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3e80ead5-2861-44fb-a195-cf3107ca1fb7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1522 microversion: 2.1 time: 0.166442 Jul 25 12:16:28.119051 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 133/265] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:27 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:28.131958 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2710db33-17e6-4b80-b849-c008f8c4f72d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:28.133298 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2710db33-17e6-4b80-b849-c008f8c4f72d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:28.140527 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2710db33-17e6-4b80-b849-c008f8c4f72d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:28.141077 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2710db33-17e6-4b80-b849-c008f8c4f72d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:28.142542 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2710db33-17e6-4b80-b849-c008f8c4f72d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:28.143031 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2710db33-17e6-4b80-b849-c008f8c4f72d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:28.270048 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2710db33-17e6-4b80-b849-c008f8c4f72d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:28.277397 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2710db33-17e6-4b80-b849-c008f8c4f72d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.149953 Jul 25 12:16:28.278039 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 133/266] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:28 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:28.530332 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-666b1944-d7bf-4874-8e69-002293ade31f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:28.530866 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-666b1944-d7bf-4874-8e69-002293ade31f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:28.537563 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-666b1944-d7bf-4874-8e69-002293ade31f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:28.538576 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-666b1944-d7bf-4874-8e69-002293ade31f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:28.540102 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-666b1944-d7bf-4874-8e69-002293ade31f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:28.540777 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-666b1944-d7bf-4874-8e69-002293ade31f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:28.624690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-666b1944-d7bf-4874-8e69-002293ade31f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:28.632982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-666b1944-d7bf-4874-8e69-002293ade31f tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1273 microversion: 2.1 time: 0.107169 Jul 25 12:16:28.634388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 134/267] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:28 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:29.142888 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2657eedc-988e-4dea-a8e2-600c2501858d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:29.144444 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2657eedc-988e-4dea-a8e2-600c2501858d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:29.151181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2657eedc-988e-4dea-a8e2-600c2501858d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:29.151668 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2657eedc-988e-4dea-a8e2-600c2501858d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:29.152433 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2657eedc-988e-4dea-a8e2-600c2501858d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:29.152868 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2657eedc-988e-4dea-a8e2-600c2501858d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:29.298145 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5d62a3db-06ee-4adf-a8f7-d7fe8b8e2e97 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:29.298742 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5d62a3db-06ee-4adf-a8f7-d7fe8b8e2e97 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:29.304977 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5d62a3db-06ee-4adf-a8f7-d7fe8b8e2e97 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:29.305417 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5d62a3db-06ee-4adf-a8f7-d7fe8b8e2e97 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:29.306177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5d62a3db-06ee-4adf-a8f7-d7fe8b8e2e97 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:29.306604 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5d62a3db-06ee-4adf-a8f7-d7fe8b8e2e97 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:29.323454 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2657eedc-988e-4dea-a8e2-600c2501858d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:29.333765 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2657eedc-988e-4dea-a8e2-600c2501858d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1502 microversion: 2.1 time: 0.195553 Jul 25 12:16:29.334341 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 134/268] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:29 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:29.361698 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-18ed517c-90f7-4bbe-9637-9e2ba825b7cf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:29.363242 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-18ed517c-90f7-4bbe-9637-9e2ba825b7cf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:29.370726 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-18ed517c-90f7-4bbe-9637-9e2ba825b7cf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:29.371185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-18ed517c-90f7-4bbe-9637-9e2ba825b7cf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:29.372109 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-18ed517c-90f7-4bbe-9637-9e2ba825b7cf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:29.372540 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-18ed517c-90f7-4bbe-9637-9e2ba825b7cf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:29.481710 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5d62a3db-06ee-4adf-a8f7-d7fe8b8e2e97 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:29.489984 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5d62a3db-06ee-4adf-a8f7-d7fe8b8e2e97 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.195579 Jul 25 12:16:29.491351 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 135/269] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:29 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:29.539043 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-543da941-f35e-45ec-8da6-581e08373595 req-1c017649-297d-4824-8d01-3f80a50b6428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6facc5-40af-42cb-80fe-268e5a380a6b", "name": "network-vif-plugged", "status": "completed", "tag": "18e2de81-a509-4850-99c1-f87dfe2e51c2"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:29.548900 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-543da941-f35e-45ec-8da6-581e08373595 req-1c017649-297d-4824-8d01-3f80a50b6428 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:29.549344 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-543da941-f35e-45ec-8da6-581e08373595 req-1c017649-297d-4824-8d01-3f80a50b6428 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:29.562035 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-543da941-f35e-45ec-8da6-581e08373595 req-1c017649-297d-4824-8d01-3f80a50b6428 service nova] Creating event network-vif-plugged:18e2de81-a509-4850-99c1-f87dfe2e51c2 for instance 5d6facc5-40af-42cb-80fe-268e5a380a6b on hv-cinder-79760 Jul 25 12:16:29.567507 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-543da941-f35e-45ec-8da6-581e08373595 req-1c017649-297d-4824-8d01-3f80a50b6428 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032065 Jul 25 12:16:29.568188 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 136/270] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:16:29.612340 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-18ed517c-90f7-4bbe-9637-9e2ba825b7cf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:29.628874 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-18ed517c-90f7-4bbe-9637-9e2ba825b7cf tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1516 microversion: 2.1 time: 0.272105 Jul 25 12:16:29.629844 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 135/271] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:29 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1516 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:29.654591 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3ccc0e68-99aa-4dc1-818b-9b12d50b1d23 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:29.655724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3ccc0e68-99aa-4dc1-818b-9b12d50b1d23 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:29.664305 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ccc0e68-99aa-4dc1-818b-9b12d50b1d23 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:29.664966 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ccc0e68-99aa-4dc1-818b-9b12d50b1d23 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:29.666018 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ccc0e68-99aa-4dc1-818b-9b12d50b1d23 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:29.666783 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ccc0e68-99aa-4dc1-818b-9b12d50b1d23 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:29.833466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3ccc0e68-99aa-4dc1-818b-9b12d50b1d23 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:29.842289 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3ccc0e68-99aa-4dc1-818b-9b12d50b1d23 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1313 microversion: 2.1 time: 0.192080 Jul 25 12:16:29.857128 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 137/272] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:29 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:30.219819 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-746c1e2e-fd9a-41c7-9775-4595ff074520 req-39779455-caa3-4bb2-b6bc-ede6191a8245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5f873f-cab0-494e-9a84-489f10555c0a", "tag": "2132f194-38ba-4596-940b-0c6aab6fe2ef"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:30.231152 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-746c1e2e-fd9a-41c7-9775-4595ff074520 req-39779455-caa3-4bb2-b6bc-ede6191a8245 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:30.231948 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-746c1e2e-fd9a-41c7-9775-4595ff074520 req-39779455-caa3-4bb2-b6bc-ede6191a8245 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:30.235939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:30.244708 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-746c1e2e-fd9a-41c7-9775-4595ff074520 req-39779455-caa3-4bb2-b6bc-ede6191a8245 service nova] Creating event network-changed:2132f194-38ba-4596-940b-0c6aab6fe2ef for instance 0d5f873f-cab0-494e-9a84-489f10555c0a on hv-cinder-79760 Jul 25 12:16:30.250446 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-746c1e2e-fd9a-41c7-9775-4595ff074520 req-39779455-caa3-4bb2-b6bc-ede6191a8245 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035107 Jul 25 12:16:30.251316 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 136/273] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:30.511343 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a9642205-60f5-4644-b264-d84bde183337 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:30.512098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a9642205-60f5-4644-b264-d84bde183337 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:30.518157 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9642205-60f5-4644-b264-d84bde183337 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:30.518604 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9642205-60f5-4644-b264-d84bde183337 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:30.519402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9642205-60f5-4644-b264-d84bde183337 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:30.519875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9642205-60f5-4644-b264-d84bde183337 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:30.655731 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a9642205-60f5-4644-b264-d84bde183337 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:30.664510 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a9642205-60f5-4644-b264-d84bde183337 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.156999 Jul 25 12:16:30.665078 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 138/274] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:30 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:30.863508 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-04ee0185-c58d-4f1d-988e-f9740c4b1c89 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:30.864155 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-04ee0185-c58d-4f1d-988e-f9740c4b1c89 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:30.870316 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-04ee0185-c58d-4f1d-988e-f9740c4b1c89 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:30.870759 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-04ee0185-c58d-4f1d-988e-f9740c4b1c89 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:30.871520 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-04ee0185-c58d-4f1d-988e-f9740c4b1c89 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:30.872115 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-04ee0185-c58d-4f1d-988e-f9740c4b1c89 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:31.070047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-04ee0185-c58d-4f1d-988e-f9740c4b1c89 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:31.077623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-04ee0185-c58d-4f1d-988e-f9740c4b1c89 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1313 microversion: 2.1 time: 0.218430 Jul 25 12:16:31.078196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 137/275] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:30 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:31.148411 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4cac94b5-5d61-4216-8747-400899d8dfed tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:31.150695 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4cac94b5-5d61-4216-8747-400899d8dfed tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:31.156752 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4cac94b5-5d61-4216-8747-400899d8dfed tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:31.157292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4cac94b5-5d61-4216-8747-400899d8dfed tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:31.158058 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4cac94b5-5d61-4216-8747-400899d8dfed tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:31.158743 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4cac94b5-5d61-4216-8747-400899d8dfed tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:31.181279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-4cac94b5-5d61-4216-8747-400899d8dfed tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lazy-loading 'flavor' on Instance uuid c9644e94-ac1d-497c-868e-36945ba75fa6 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:16:31.286067 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4cac94b5-5d61-4216-8747-400899d8dfed tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "POST /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6/action" status: 200 len: 32 microversion: 2.1 time: 0.145753 Jul 25 12:16:31.286665 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 139/276] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:16:31 2022] POST /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6/action => generated 32 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:16:31.295994 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-97ae04ea-4596-43ac-8197-b6b1d82c9990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:31.296600 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-97ae04ea-4596-43ac-8197-b6b1d82c9990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:31.303462 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97ae04ea-4596-43ac-8197-b6b1d82c9990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:31.303948 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97ae04ea-4596-43ac-8197-b6b1d82c9990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:31.304697 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97ae04ea-4596-43ac-8197-b6b1d82c9990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:31.305127 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97ae04ea-4596-43ac-8197-b6b1d82c9990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:31.436962 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-97ae04ea-4596-43ac-8197-b6b1d82c9990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:31.444995 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-97ae04ea-4596-43ac-8197-b6b1d82c9990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.152777 Jul 25 12:16:31.445551 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 138/277] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:31 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:31.685842 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f231b306-485b-4c70-ba30-f59914e28a6b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:31.686463 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f231b306-485b-4c70-ba30-f59914e28a6b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:31.693267 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f231b306-485b-4c70-ba30-f59914e28a6b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:31.693719 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f231b306-485b-4c70-ba30-f59914e28a6b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:31.694483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f231b306-485b-4c70-ba30-f59914e28a6b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:31.694919 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f231b306-485b-4c70-ba30-f59914e28a6b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:31.829716 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f231b306-485b-4c70-ba30-f59914e28a6b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:31.838438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f231b306-485b-4c70-ba30-f59914e28a6b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1359 microversion: 2.1 time: 0.156826 Jul 25 12:16:31.839264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 140/278] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:31 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:32.098729 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dfa5157d-5489-47b2-a3f3-2c206b9b7fee tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:32.099370 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dfa5157d-5489-47b2-a3f3-2c206b9b7fee tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:32.105339 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dfa5157d-5489-47b2-a3f3-2c206b9b7fee tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:32.105791 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dfa5157d-5489-47b2-a3f3-2c206b9b7fee tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:32.106542 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dfa5157d-5489-47b2-a3f3-2c206b9b7fee tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:32.106978 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dfa5157d-5489-47b2-a3f3-2c206b9b7fee tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:32.424315 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dfa5157d-5489-47b2-a3f3-2c206b9b7fee tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:32.431684 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dfa5157d-5489-47b2-a3f3-2c206b9b7fee tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1313 microversion: 2.1 time: 0.337285 Jul 25 12:16:32.432246 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 139/279] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:32 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:32.466528 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-387ad5f3-552b-49bb-9c6c-25902022553b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:32.467497 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-387ad5f3-552b-49bb-9c6c-25902022553b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:32.470582 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:32.479470 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-387ad5f3-552b-49bb-9c6c-25902022553b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:32.479953 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-387ad5f3-552b-49bb-9c6c-25902022553b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:32.480754 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-387ad5f3-552b-49bb-9c6c-25902022553b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:32.481205 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-387ad5f3-552b-49bb-9c6c-25902022553b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:32.632628 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-387ad5f3-552b-49bb-9c6c-25902022553b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:32.641016 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-387ad5f3-552b-49bb-9c6c-25902022553b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.178988 Jul 25 12:16:32.641804 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 141/280] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:32 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:32.861883 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-82c3f77c-9cb9-485b-89a0-487df8f607f3 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:32.863123 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-82c3f77c-9cb9-485b-89a0-487df8f607f3 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:32.869285 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82c3f77c-9cb9-485b-89a0-487df8f607f3 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:32.869735 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82c3f77c-9cb9-485b-89a0-487df8f607f3 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:32.870484 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82c3f77c-9cb9-485b-89a0-487df8f607f3 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:32.870911 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-82c3f77c-9cb9-485b-89a0-487df8f607f3 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:33.009838 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-82c3f77c-9cb9-485b-89a0-487df8f607f3 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:33.018080 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-82c3f77c-9cb9-485b-89a0-487df8f607f3 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1548 microversion: 2.1 time: 0.160452 Jul 25 12:16:33.018641 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 140/281] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:32 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:33.039368 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d3601f61-d771-41b3-8f91-31d2e6475ab2 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:33.040075 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d3601f61-d771-41b3-8f91-31d2e6475ab2 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:33.046317 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3601f61-d771-41b3-8f91-31d2e6475ab2 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:33.046990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3601f61-d771-41b3-8f91-31d2e6475ab2 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:33.047942 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3601f61-d771-41b3-8f91-31d2e6475ab2 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:33.048634 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d3601f61-d771-41b3-8f91-31d2e6475ab2 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:33.240473 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d3601f61-d771-41b3-8f91-31d2e6475ab2 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:33.249315 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d3601f61-d771-41b3-8f91-31d2e6475ab2 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1548 microversion: 2.1 time: 0.213591 Jul 25 12:16:33.249884 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 142/282] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:33 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1548 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:33.270855 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-af8de4af-202a-4faf-b1ce-d151622a0887 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:33.277530 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-af8de4af-202a-4faf-b1ce-d151622a0887 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:33.278816 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-af8de4af-202a-4faf-b1ce-d151622a0887 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Searching by: {'deleted': False, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4'} {{(pid=117776) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:16:33.297306 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af8de4af-202a-4faf-b1ce-d151622a0887 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:33.298194 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af8de4af-202a-4faf-b1ce-d151622a0887 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:33.300675 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af8de4af-202a-4faf-b1ce-d151622a0887 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:33.301427 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-af8de4af-202a-4faf-b1ce-d151622a0887 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:33.408945 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.multi_cell_list [None req-af8de4af-202a-4faf-b1ce-d151622a0887 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:16:33.452468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7c53e638-90ff-4101-98c3-2c0b5aa11900 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:33.453081 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7c53e638-90ff-4101-98c3-2c0b5aa11900 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:33.469524 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7c53e638-90ff-4101-98c3-2c0b5aa11900 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:33.471590 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7c53e638-90ff-4101-98c3-2c0b5aa11900 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:33.475173 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7c53e638-90ff-4101-98c3-2c0b5aa11900 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:33.478918 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7c53e638-90ff-4101-98c3-2c0b5aa11900 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:33.518949 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-af8de4af-202a-4faf-b1ce-d151622a0887 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.252331 Jul 25 12:16:33.525696 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 141/283] 10.222.0.42 () {58 vars in 1125 bytes} [Mon Jul 25 12:16:33 2022] GET /compute/v2.1/servers => generated 343 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:33.536199 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b34f3f47-40b6-4328-8b9c-09363df387b7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:33.537282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b34f3f47-40b6-4328-8b9c-09363df387b7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:33.545898 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b34f3f47-40b6-4328-8b9c-09363df387b7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:33.546604 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b34f3f47-40b6-4328-8b9c-09363df387b7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:33.547886 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b34f3f47-40b6-4328-8b9c-09363df387b7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:33.548521 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b34f3f47-40b6-4328-8b9c-09363df387b7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:33.698193 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7c53e638-90ff-4101-98c3-2c0b5aa11900 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:33.707024 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7c53e638-90ff-4101-98c3-2c0b5aa11900 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1313 microversion: 2.1 time: 0.257839 Jul 25 12:16:33.707935 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 143/284] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:33 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:33.712596 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3af4fe00-3a97-4e97-b653-61a194d79744 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:33.713448 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3af4fe00-3a97-4e97-b653-61a194d79744 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:33.720403 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3af4fe00-3a97-4e97-b653-61a194d79744 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:33.721115 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3af4fe00-3a97-4e97-b653-61a194d79744 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:33.722685 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3af4fe00-3a97-4e97-b653-61a194d79744 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:33.723356 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3af4fe00-3a97-4e97-b653-61a194d79744 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:33.889154 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b34f3f47-40b6-4328-8b9c-09363df387b7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:33.890502 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3af4fe00-3a97-4e97-b653-61a194d79744 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:33.897928 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:33.900867 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3af4fe00-3a97-4e97-b653-61a194d79744 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.191725 Jul 25 12:16:33.901530 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b34f3f47-40b6-4328-8b9c-09363df387b7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1548 microversion: 2.1 time: 0.374606 Jul 25 12:16:33.902241 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 144/285] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:33 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:33.916476 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 142/286] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:33 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1548 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:34.730690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c9a16958-ace7-463e-a673-c0d860919a59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:34.731299 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c9a16958-ace7-463e-a673-c0d860919a59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:34.738347 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9a16958-ace7-463e-a673-c0d860919a59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:34.738791 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9a16958-ace7-463e-a673-c0d860919a59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:34.739567 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9a16958-ace7-463e-a673-c0d860919a59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:34.740009 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c9a16958-ace7-463e-a673-c0d860919a59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:34.882317 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c9a16958-ace7-463e-a673-c0d860919a59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:34.889649 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c9a16958-ace7-463e-a673-c0d860919a59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1313 microversion: 2.1 time: 0.163051 Jul 25 12:16:34.890213 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 145/287] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:34 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:34.922231 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-70feb467-7efe-4c57-871d-afa791656a29 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:34.922835 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-70feb467-7efe-4c57-871d-afa791656a29 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:34.930130 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-70feb467-7efe-4c57-871d-afa791656a29 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:34.930574 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-70feb467-7efe-4c57-871d-afa791656a29 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:34.931320 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-70feb467-7efe-4c57-871d-afa791656a29 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:34.931771 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-70feb467-7efe-4c57-871d-afa791656a29 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:35.067367 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-70feb467-7efe-4c57-871d-afa791656a29 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:35.074799 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-70feb467-7efe-4c57-871d-afa791656a29 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.156308 Jul 25 12:16:35.075404 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 143/288] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:34 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:35.558379 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-eae2df26-f4b7-435d-95fa-4d8b93f63f8f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04be480f-0e31-43a2-a203-6bdf76350cd3"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:35.560923 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-eae2df26-f4b7-435d-95fa-4d8b93f63f8f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:35.567998 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eae2df26-f4b7-435d-95fa-4d8b93f63f8f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:35.568441 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eae2df26-f4b7-435d-95fa-4d8b93f63f8f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:35.569209 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eae2df26-f4b7-435d-95fa-4d8b93f63f8f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:35.569638 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eae2df26-f4b7-435d-95fa-4d8b93f63f8f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:35.661517 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-288b4b8e-f0e4-41ba-9364-c8243471bac5 req-45308b35-3de6-41ad-824a-b9fceb3e1cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5f873f-cab0-494e-9a84-489f10555c0a", "name": "network-vif-plugged", "status": "completed", "tag": "2132f194-38ba-4596-940b-0c6aab6fe2ef"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:35.671622 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-288b4b8e-f0e4-41ba-9364-c8243471bac5 req-45308b35-3de6-41ad-824a-b9fceb3e1cb3 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:35.672266 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-288b4b8e-f0e4-41ba-9364-c8243471bac5 req-45308b35-3de6-41ad-824a-b9fceb3e1cb3 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:35.684393 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-288b4b8e-f0e4-41ba-9364-c8243471bac5 req-45308b35-3de6-41ad-824a-b9fceb3e1cb3 service nova] Creating event network-vif-plugged:2132f194-38ba-4596-940b-0c6aab6fe2ef for instance 0d5f873f-cab0-494e-9a84-489f10555c0a on hv-cinder-79760 Jul 25 12:16:35.689137 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-288b4b8e-f0e4-41ba-9364-c8243471bac5 req-45308b35-3de6-41ad-824a-b9fceb3e1cb3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031513 Jul 25 12:16:35.689771 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 144/289] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:16:35.907390 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-eae2df26-f4b7-435d-95fa-4d8b93f63f8f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "POST /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352787 Jul 25 12:16:35.911286 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d40d77ff-3ddb-4222-a7c8-d7bf9f59721b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:35.912012 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d40d77ff-3ddb-4222-a7c8-d7bf9f59721b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:35.913887 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 146/290] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:16:35 2022] POST /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:35.921886 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d40d77ff-3ddb-4222-a7c8-d7bf9f59721b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:35.922517 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d40d77ff-3ddb-4222-a7c8-d7bf9f59721b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:35.924048 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d40d77ff-3ddb-4222-a7c8-d7bf9f59721b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:35.924504 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d40d77ff-3ddb-4222-a7c8-d7bf9f59721b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:36.057523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d40d77ff-3ddb-4222-a7c8-d7bf9f59721b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:36.065018 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d40d77ff-3ddb-4222-a7c8-d7bf9f59721b tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1313 microversion: 2.1 time: 0.158376 Jul 25 12:16:36.065653 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 145/291] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:35 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:36.098097 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-59b7996d-7143-4ecc-8c65-bdfa4648230c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:36.098795 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-59b7996d-7143-4ecc-8c65-bdfa4648230c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:36.104999 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59b7996d-7143-4ecc-8c65-bdfa4648230c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:36.105450 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59b7996d-7143-4ecc-8c65-bdfa4648230c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:36.106217 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59b7996d-7143-4ecc-8c65-bdfa4648230c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:36.106655 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-59b7996d-7143-4ecc-8c65-bdfa4648230c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:36.241126 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-59b7996d-7143-4ecc-8c65-bdfa4648230c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:36.248889 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-59b7996d-7143-4ecc-8c65-bdfa4648230c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.155958 Jul 25 12:16:36.249555 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 147/292] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:36 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:37.085513 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-084d3839-44ef-4a76-bf85-7d6adb6d8d79 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:37.086122 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-084d3839-44ef-4a76-bf85-7d6adb6d8d79 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:37.088101 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:37.093871 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-084d3839-44ef-4a76-bf85-7d6adb6d8d79 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:37.094349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-084d3839-44ef-4a76-bf85-7d6adb6d8d79 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:37.095102 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-084d3839-44ef-4a76-bf85-7d6adb6d8d79 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:37.095534 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-084d3839-44ef-4a76-bf85-7d6adb6d8d79 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:37.222532 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-084d3839-44ef-4a76-bf85-7d6adb6d8d79 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:37.229868 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-084d3839-44ef-4a76-bf85-7d6adb6d8d79 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1313 microversion: 2.1 time: 0.148074 Jul 25 12:16:37.230424 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 146/293] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:37 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:37.269609 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fe94ea6e-e5f2-42fa-910b-ad98b6fc4747 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:37.270224 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fe94ea6e-e5f2-42fa-910b-ad98b6fc4747 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:37.272888 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:37.278399 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe94ea6e-e5f2-42fa-910b-ad98b6fc4747 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:37.278841 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe94ea6e-e5f2-42fa-910b-ad98b6fc4747 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:37.279614 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe94ea6e-e5f2-42fa-910b-ad98b6fc4747 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:37.280044 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fe94ea6e-e5f2-42fa-910b-ad98b6fc4747 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:37.406935 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fe94ea6e-e5f2-42fa-910b-ad98b6fc4747 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:37.415384 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fe94ea6e-e5f2-42fa-910b-ad98b6fc4747 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.149699 Jul 25 12:16:37.415985 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 148/294] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:37 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:38.251026 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-517cd451-7358-4d0c-b43b-61634e62056c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:38.251517 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-517cd451-7358-4d0c-b43b-61634e62056c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:38.258593 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-517cd451-7358-4d0c-b43b-61634e62056c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:38.259034 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-517cd451-7358-4d0c-b43b-61634e62056c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:38.259808 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-517cd451-7358-4d0c-b43b-61634e62056c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:38.260251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-517cd451-7358-4d0c-b43b-61634e62056c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:38.392400 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-517cd451-7358-4d0c-b43b-61634e62056c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:38.399627 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-517cd451-7358-4d0c-b43b-61634e62056c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1496 microversion: 2.1 time: 0.152570 Jul 25 12:16:38.400175 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 147/295] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:38 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1496 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:38.437965 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4ad6f203-139d-484a-bc15-fba7bad6f2d0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:38.438593 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4ad6f203-139d-484a-bc15-fba7bad6f2d0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:38.446817 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ad6f203-139d-484a-bc15-fba7bad6f2d0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:38.447341 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ad6f203-139d-484a-bc15-fba7bad6f2d0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:38.448148 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ad6f203-139d-484a-bc15-fba7bad6f2d0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:38.448584 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4ad6f203-139d-484a-bc15-fba7bad6f2d0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:38.584937 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4ad6f203-139d-484a-bc15-fba7bad6f2d0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:38.592442 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4ad6f203-139d-484a-bc15-fba7bad6f2d0 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.158864 Jul 25 12:16:38.593010 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 149/296] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:38 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:38.893919 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dbcdcbb4-c829-46ed-b919-ea020851c079 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:38.894414 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dbcdcbb4-c829-46ed-b919-ea020851c079 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:38.900338 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dbcdcbb4-c829-46ed-b919-ea020851c079 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:38.900788 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dbcdcbb4-c829-46ed-b919-ea020851c079 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:38.901544 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dbcdcbb4-c829-46ed-b919-ea020851c079 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:38.901980 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dbcdcbb4-c829-46ed-b919-ea020851c079 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:38.926608 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dbcdcbb4-c829-46ed-b919-ea020851c079 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:16:39.007905 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dbcdcbb4-c829-46ed-b919-ea020851c079 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 204 len: 0 microversion: 2.1 time: 0.117821 Jul 25 12:16:39.008757 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 148/297] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:16:38 2022] DELETE /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:16:39.017758 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c76b9b0a-a365-4e90-b5cf-50b7bc7d6d58 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:39.018900 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c76b9b0a-a365-4e90-b5cf-50b7bc7d6d58 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:39.025144 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c76b9b0a-a365-4e90-b5cf-50b7bc7d6d58 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:39.025580 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c76b9b0a-a365-4e90-b5cf-50b7bc7d6d58 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:39.026331 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c76b9b0a-a365-4e90-b5cf-50b7bc7d6d58 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:39.026752 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c76b9b0a-a365-4e90-b5cf-50b7bc7d6d58 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:39.169669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c76b9b0a-a365-4e90-b5cf-50b7bc7d6d58 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:39.178192 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c76b9b0a-a365-4e90-b5cf-50b7bc7d6d58 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1502 microversion: 2.1 time: 0.164463 Jul 25 12:16:39.178758 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 150/298] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:39 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:39.615309 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f907f441-deae-4258-b65f-213a06285c1f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:39.615933 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f907f441-deae-4258-b65f-213a06285c1f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:39.622373 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f907f441-deae-4258-b65f-213a06285c1f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:39.622833 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f907f441-deae-4258-b65f-213a06285c1f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:39.623662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f907f441-deae-4258-b65f-213a06285c1f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:39.624098 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f907f441-deae-4258-b65f-213a06285c1f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:39.760067 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f907f441-deae-4258-b65f-213a06285c1f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:39.767886 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f907f441-deae-4258-b65f-213a06285c1f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.157296 Jul 25 12:16:39.769542 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 149/299] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:39 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:40.199517 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0f59af67-d28b-490a-9447-53eafd9dfb59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:40.200224 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0f59af67-d28b-490a-9447-53eafd9dfb59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:40.207330 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f59af67-d28b-490a-9447-53eafd9dfb59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:40.207884 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f59af67-d28b-490a-9447-53eafd9dfb59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:40.208838 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f59af67-d28b-490a-9447-53eafd9dfb59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:40.209263 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0f59af67-d28b-490a-9447-53eafd9dfb59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:40.479822 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0f59af67-d28b-490a-9447-53eafd9dfb59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:40.487351 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0f59af67-d28b-490a-9447-53eafd9dfb59 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1502 microversion: 2.1 time: 0.291632 Jul 25 12:16:40.488107 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 151/300] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:40 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1502 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:40.788856 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a0b767c4-c085-4a14-b2d0-54232e0461e1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:40.789463 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a0b767c4-c085-4a14-b2d0-54232e0461e1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:40.796877 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0b767c4-c085-4a14-b2d0-54232e0461e1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:40.797373 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0b767c4-c085-4a14-b2d0-54232e0461e1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:40.798349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0b767c4-c085-4a14-b2d0-54232e0461e1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:40.798790 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a0b767c4-c085-4a14-b2d0-54232e0461e1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:40.939297 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a0b767c4-c085-4a14-b2d0-54232e0461e1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:40.947318 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a0b767c4-c085-4a14-b2d0-54232e0461e1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.162247 Jul 25 12:16:40.947900 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 150/301] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:40 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:41.508961 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3044fae1-b29c-465f-ad08-1debb5dd030d tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:41.511675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3044fae1-b29c-465f-ad08-1debb5dd030d tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:41.531202 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3044fae1-b29c-465f-ad08-1debb5dd030d tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:41.532005 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3044fae1-b29c-465f-ad08-1debb5dd030d tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:41.533006 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3044fae1-b29c-465f-ad08-1debb5dd030d tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:41.534445 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3044fae1-b29c-465f-ad08-1debb5dd030d tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:41.592255 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-3a8ba752-f277-489e-8d06-df6b130259fc req-9c814199-4a78-4671-aeaf-72987dbd3749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5f873f-cab0-494e-9a84-489f10555c0a", "name": "network-vif-deleted", "tag": "2132f194-38ba-4596-940b-0c6aab6fe2ef"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:41.609114 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-3a8ba752-f277-489e-8d06-df6b130259fc req-9c814199-4a78-4671-aeaf-72987dbd3749 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:41.609586 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-3a8ba752-f277-489e-8d06-df6b130259fc req-9c814199-4a78-4671-aeaf-72987dbd3749 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:41.624237 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3044fae1-b29c-465f-ad08-1debb5dd030d tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:41.627323 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-3a8ba752-f277-489e-8d06-df6b130259fc req-9c814199-4a78-4671-aeaf-72987dbd3749 service nova] Creating event network-vif-deleted:2132f194-38ba-4596-940b-0c6aab6fe2ef for instance 0d5f873f-cab0-494e-9a84-489f10555c0a on hv-cinder-79760 Jul 25 12:16:41.632587 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-3a8ba752-f277-489e-8d06-df6b130259fc req-9c814199-4a78-4671-aeaf-72987dbd3749 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044127 Jul 25 12:16:41.638289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 151/302] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:41.640092 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3044fae1-b29c-465f-ad08-1debb5dd030d tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1460 microversion: 2.1 time: 0.135724 Jul 25 12:16:41.640698 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 152/303] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:41 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1460 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:41.970012 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-47f39d1f-8426-45fd-be4a-2be0ef2b0f45 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:41.970712 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-47f39d1f-8426-45fd-be4a-2be0ef2b0f45 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:41.977754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47f39d1f-8426-45fd-be4a-2be0ef2b0f45 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:41.978199 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47f39d1f-8426-45fd-be4a-2be0ef2b0f45 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:41.978967 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47f39d1f-8426-45fd-be4a-2be0ef2b0f45 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:41.979402 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-47f39d1f-8426-45fd-be4a-2be0ef2b0f45 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:42.156011 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-47f39d1f-8426-45fd-be4a-2be0ef2b0f45 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:42.172916 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:42.178193 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-47f39d1f-8426-45fd-be4a-2be0ef2b0f45 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.212850 Jul 25 12:16:42.178997 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 152/304] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:41 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:42.663841 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5e50c913-0597-4b4f-8620-72dd9fb72b96 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:42.664481 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5e50c913-0597-4b4f-8620-72dd9fb72b96 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:42.671850 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e50c913-0597-4b4f-8620-72dd9fb72b96 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:42.672399 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e50c913-0597-4b4f-8620-72dd9fb72b96 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:42.673497 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e50c913-0597-4b4f-8620-72dd9fb72b96 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:42.674032 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e50c913-0597-4b4f-8620-72dd9fb72b96 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:42.707295 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e50c913-0597-4b4f-8620-72dd9fb72b96 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:42.707796 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e50c913-0597-4b4f-8620-72dd9fb72b96 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:42.708245 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-5e50c913-0597-4b4f-8620-72dd9fb72b96 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lazy-loading 'fault' on Instance uuid 0d5f873f-cab0-494e-9a84-489f10555c0a {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:16:42.749732 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5e50c913-0597-4b4f-8620-72dd9fb72b96 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f696b65c8094119af332e7e837b888e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bd04f2c9d34640ab6317fc8dd3dddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:42.757729 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5e50c913-0597-4b4f-8620-72dd9fb72b96 tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 200 len: 1303 microversion: 2.1 time: 0.097917 Jul 25 12:16:42.758291 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 153/305] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:42 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:43.199486 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-17b33bf9-f0df-4008-9178-a83d1492e574 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:43.200160 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-17b33bf9-f0df-4008-9178-a83d1492e574 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:43.209807 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17b33bf9-f0df-4008-9178-a83d1492e574 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:43.210264 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17b33bf9-f0df-4008-9178-a83d1492e574 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:43.211174 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17b33bf9-f0df-4008-9178-a83d1492e574 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:43.211638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17b33bf9-f0df-4008-9178-a83d1492e574 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:43.341227 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:43.416535 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-490a9149-0b36-4aef-b927-b89bf72bd5e3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:43.417067 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-490a9149-0b36-4aef-b927-b89bf72bd5e3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:43.425369 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-490a9149-0b36-4aef-b927-b89bf72bd5e3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:43.426022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-490a9149-0b36-4aef-b927-b89bf72bd5e3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:43.426878 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-490a9149-0b36-4aef-b927-b89bf72bd5e3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:43.427399 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-490a9149-0b36-4aef-b927-b89bf72bd5e3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:43.440321 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-17b33bf9-f0df-4008-9178-a83d1492e574 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:43.451714 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-17b33bf9-f0df-4008-9178-a83d1492e574 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.255956 Jul 25 12:16:43.452858 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 153/306] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:43 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:43.453987 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-490a9149-0b36-4aef-b927-b89bf72bd5e3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/ips" status: 200 len: 144 microversion: 2.1 time: 0.043031 Jul 25 12:16:43.456102 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 154/307] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Jul 25 12:16:43 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/ips => generated 144 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:16:43.714754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-354e234f-a0f5-4f27-b22d-c28c6ebe23fd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:43.715451 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-354e234f-a0f5-4f27-b22d-c28c6ebe23fd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:43.721492 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-354e234f-a0f5-4f27-b22d-c28c6ebe23fd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:43.721946 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-354e234f-a0f5-4f27-b22d-c28c6ebe23fd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:43.722786 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-354e234f-a0f5-4f27-b22d-c28c6ebe23fd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:43.723226 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-354e234f-a0f5-4f27-b22d-c28c6ebe23fd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:43.746377 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-354e234f-a0f5-4f27-b22d-c28c6ebe23fd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/ips" status: 200 len: 151 microversion: 2.20 time: 0.035598 Jul 25 12:16:43.747190 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 154/308] 10.222.0.42 () {60 vars in 1289 bytes} [Mon Jul 25 12:16:43 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:16:43.780482 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b0d2c99e-96fe-46ef-8144-07686c2da19c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:43.781740 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b0d2c99e-96fe-46ef-8144-07686c2da19c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] [instance: 0d5f873f-cab0-494e-9a84-489f10555c0a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:43.788764 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0d2c99e-96fe-46ef-8144-07686c2da19c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:43.789211 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0d2c99e-96fe-46ef-8144-07686c2da19c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:43.789980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0d2c99e-96fe-46ef-8144-07686c2da19c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:43.790570 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0d2c99e-96fe-46ef-8144-07686c2da19c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:43.804974 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-b0d2c99e-96fe-46ef-8144-07686c2da19c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] HTTP exception thrown: Instance 0d5f873f-cab0-494e-9a84-489f10555c0a could not be found. Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b0d2c99e-96fe-46ef-8144-07686c2da19c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Request method failure captured: Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a HTTP/1.1 Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3olw-k1OPFMSXEbgHxFS-hvCdP-t5TIh5a-x6mmshdB09W3Z4PNNYJcGhv-I3yWqYJ_p9B7rTmVQwry_RvBW192p3NWl0cPuqrW5xYUdB5QNW9e5eMB03Bwg3d_9m_qXSgRFSOm-hk_BUBd1gCVC3x3kerzDQjYxflUl9sPptBkexlE Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 91bd04f2c9d34640ab6317fc8dd3dddb Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesActionsTest-308493614 Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:16:43.806931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:16:43.809362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91bd04f2c9d34640ab6317fc8dd3dddb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/91bd04f2c9d34640ab6317fc8dd3dddb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_91bd04f2c9d34640ab6317fc8dd3dddb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/91bd04f2c9d34640ab6317fc8dd3dddb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:16:43.809362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesActionsTest-308493614 Jul 25 12:16:43.809362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 91bd04f2c9d34640ab6317fc8dd3dddb Jul 25 12:16:43.809362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesActionsTest-308493614 Jul 25 12:16:43.809362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesActionsTest-308493614-project Jul 25 12:16:43.809362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:16:43.809362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:16:43.809362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 5f696b65c8094119af332e7e837b888e Jul 25 12:16:43.809362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesActionsTest-308493614-project Jul 25 12:16:43.809362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:16:43.809362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 0d5f873f-cab0-494e-9a84-489f10555c0a could not be found. Jul 25 12:16:43.809362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '0d5f873f-cab0-494e-9a84-489f10555c0a'} Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5f873f-cab0-494e-9a84-489f10555c0a could not be found. Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:16:43.810076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5f873f-cab0-494e-9a84-489f10555c0a could not be found. Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5f873f-cab0-494e-9a84-489f10555c0a could not be found. Jul 25 12:16:43.811167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:16:43.812236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b0d2c99e-96fe-46ef-8144-07686c2da19c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] Returning 404 to user: Instance 0d5f873f-cab0-494e-9a84-489f10555c0a could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:16:43.812236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b0d2c99e-96fe-46ef-8144-07686c2da19c tempest-VolumesActionsTest-308493614 tempest-VolumesActionsTest-308493614-project] 10.222.0.42 "GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a" status: 404 len: 111 microversion: 2.1 time: 0.033396 Jul 25 12:16:43.814248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 155/309] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:43 2022] GET /compute/v2.1/servers/0d5f873f-cab0-494e-9a84-489f10555c0a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:16:44.474577 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-59e289f2-2f40-4378-a1b1-489ac334beb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:44.476065 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-59e289f2-2f40-4378-a1b1-489ac334beb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:44.482929 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-59e289f2-2f40-4378-a1b1-489ac334beb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:44.483373 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-59e289f2-2f40-4378-a1b1-489ac334beb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:44.484405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-59e289f2-2f40-4378-a1b1-489ac334beb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:44.484840 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-59e289f2-2f40-4378-a1b1-489ac334beb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:44.648520 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-59e289f2-2f40-4378-a1b1-489ac334beb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:44.669864 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-59e289f2-2f40-4378-a1b1-489ac334beb6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.199597 Jul 25 12:16:44.672178 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 155/310] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:44 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:44.895303 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2a8385de-f72a-4bb3-a10e-9838a81e2d52 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:44.895947 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2a8385de-f72a-4bb3-a10e-9838a81e2d52 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:44.903040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a8385de-f72a-4bb3-a10e-9838a81e2d52 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:44.903588 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a8385de-f72a-4bb3-a10e-9838a81e2d52 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:44.904357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a8385de-f72a-4bb3-a10e-9838a81e2d52 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:44.904792 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2a8385de-f72a-4bb3-a10e-9838a81e2d52 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:45.037844 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2a8385de-f72a-4bb3-a10e-9838a81e2d52 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:45.046551 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2a8385de-f72a-4bb3-a10e-9838a81e2d52 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1594 microversion: 2.1 time: 0.155070 Jul 25 12:16:45.047120 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 156/311] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:44 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:45.615812 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3668b990-2a61-4e4c-b41d-4b7cdebcf39a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:45.616405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3668b990-2a61-4e4c-b41d-4b7cdebcf39a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:45.622854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3668b990-2a61-4e4c-b41d-4b7cdebcf39a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:45.623382 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3668b990-2a61-4e4c-b41d-4b7cdebcf39a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:45.624246 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3668b990-2a61-4e4c-b41d-4b7cdebcf39a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:45.624683 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3668b990-2a61-4e4c-b41d-4b7cdebcf39a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:45.649173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-3668b990-2a61-4e4c-b41d-4b7cdebcf39a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lazy-loading 'flavor' on Instance uuid 66654721-31e2-48d8-a0ea-c146d277ab47 {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:16:45.691130 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f881cd33-719a-4bf5-8e24-ec02519bb92a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:45.691998 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f881cd33-719a-4bf5-8e24-ec02519bb92a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:45.697924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f881cd33-719a-4bf5-8e24-ec02519bb92a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:45.698371 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f881cd33-719a-4bf5-8e24-ec02519bb92a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:45.699349 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f881cd33-719a-4bf5-8e24-ec02519bb92a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:45.699805 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f881cd33-719a-4bf5-8e24-ec02519bb92a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:45.884276 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f881cd33-719a-4bf5-8e24-ec02519bb92a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:45.895131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f881cd33-719a-4bf5-8e24-ec02519bb92a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.207783 Jul 25 12:16:45.895922 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 157/312] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:45 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:45.907848 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3668b990-2a61-4e4c-b41d-4b7cdebcf39a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "POST /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/action" status: 202 len: 0 microversion: 2.20 time: 0.295583 Jul 25 12:16:45.916583 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 156/313] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Jul 25 12:16:45 2022] POST /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:16:45.917678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e84070aa-4d0e-4810-bdc6-b13bcc020275 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:45.918298 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e84070aa-4d0e-4810-bdc6-b13bcc020275 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:45.925058 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e84070aa-4d0e-4810-bdc6-b13bcc020275 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:45.925507 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e84070aa-4d0e-4810-bdc6-b13bcc020275 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:45.926447 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e84070aa-4d0e-4810-bdc6-b13bcc020275 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:45.927041 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e84070aa-4d0e-4810-bdc6-b13bcc020275 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:46.073753 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e84070aa-4d0e-4810-bdc6-b13bcc020275 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:46.084938 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e84070aa-4d0e-4810-bdc6-b13bcc020275 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:46.086741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e84070aa-4d0e-4810-bdc6-b13bcc020275 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:46.088210 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e84070aa-4d0e-4810-bdc6-b13bcc020275 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.174408 Jul 25 12:16:46.089464 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 158/314] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:16:45 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:16:46.806629 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-9d048a19-9bdb-42fa-a958-74f46f26adb5 req-a915faaf-4f96-4af9-a3b2-81a908d943af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6facc5-40af-42cb-80fe-268e5a380a6b", "tag": "18e2de81-a509-4850-99c1-f87dfe2e51c2"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:46.817702 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-9d048a19-9bdb-42fa-a958-74f46f26adb5 req-a915faaf-4f96-4af9-a3b2-81a908d943af service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:46.818412 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-9d048a19-9bdb-42fa-a958-74f46f26adb5 req-a915faaf-4f96-4af9-a3b2-81a908d943af service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:46.829902 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-9d048a19-9bdb-42fa-a958-74f46f26adb5 req-a915faaf-4f96-4af9-a3b2-81a908d943af service nova] Creating event network-changed:18e2de81-a509-4850-99c1-f87dfe2e51c2 for instance 5d6facc5-40af-42cb-80fe-268e5a380a6b on hv-cinder-79760 Jul 25 12:16:46.835612 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-9d048a19-9bdb-42fa-a958-74f46f26adb5 req-a915faaf-4f96-4af9-a3b2-81a908d943af service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033755 Jul 25 12:16:46.836377 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 157/315] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:16:46.918525 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ae3fb592-afbe-465d-8a7c-bf5b72b2b450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:46.920163 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ae3fb592-afbe-465d-8a7c-bf5b72b2b450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:46.933243 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae3fb592-afbe-465d-8a7c-bf5b72b2b450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:46.933696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae3fb592-afbe-465d-8a7c-bf5b72b2b450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:46.934476 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae3fb592-afbe-465d-8a7c-bf5b72b2b450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:46.936120 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ae3fb592-afbe-465d-8a7c-bf5b72b2b450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:47.105155 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ae3fb592-afbe-465d-8a7c-bf5b72b2b450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:47.118061 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7ce21151-d9d1-4d9b-868f-9212608b622e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:47.118905 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7ce21151-d9d1-4d9b-868f-9212608b622e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:47.121101 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:47.127051 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ae3fb592-afbe-465d-8a7c-bf5b72b2b450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.213010 Jul 25 12:16:47.130014 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 159/316] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:46 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:47.145912 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ce21151-d9d1-4d9b-868f-9212608b622e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:47.146440 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ce21151-d9d1-4d9b-868f-9212608b622e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:47.147288 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ce21151-d9d1-4d9b-868f-9212608b622e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:47.147808 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7ce21151-d9d1-4d9b-868f-9212608b622e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:47.329517 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7ce21151-d9d1-4d9b-868f-9212608b622e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:47.339761 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7ce21151-d9d1-4d9b-868f-9212608b622e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:47.341294 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7ce21151-d9d1-4d9b-868f-9212608b622e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:47.342672 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7ce21151-d9d1-4d9b-868f-9212608b622e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.233753 Jul 25 12:16:47.343252 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 158/317] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:16:47 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:16:47.854316 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f5dd25f8-dabc-4889-a426-4b28e94cc1d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-960971857"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:47.854868 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f5dd25f8-dabc-4889-a426-4b28e94cc1d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:47.861330 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5dd25f8-dabc-4889-a426-4b28e94cc1d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:47.861829 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5dd25f8-dabc-4889-a426-4b28e94cc1d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:47.862608 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5dd25f8-dabc-4889-a426-4b28e94cc1d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:47.863219 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f5dd25f8-dabc-4889-a426-4b28e94cc1d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:48.018200 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.network.security_group_api [None req-f5dd25f8-dabc-4889-a426-4b28e94cc1d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Adding security group 2d457c22-8406-4866-9e2a-22b419b5987b to port 18e2de81-a509-4850-99c1-f87dfe2e51c2 Jul 25 12:16:48.150278 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4277bb81-66f5-476d-bf56-417f75d0766e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:48.151438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4277bb81-66f5-476d-bf56-417f75d0766e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:48.159304 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4277bb81-66f5-476d-bf56-417f75d0766e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:48.159793 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4277bb81-66f5-476d-bf56-417f75d0766e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:48.160566 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4277bb81-66f5-476d-bf56-417f75d0766e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:48.161072 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4277bb81-66f5-476d-bf56-417f75d0766e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:48.372262 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4277bb81-66f5-476d-bf56-417f75d0766e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:48.380526 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4277bb81-66f5-476d-bf56-417f75d0766e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.234008 Jul 25 12:16:48.381261 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 159/318] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:48 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:48.386259 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-462773df-52cf-4982-bd9f-ce184a3fdbb3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:48.387107 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-462773df-52cf-4982-bd9f-ce184a3fdbb3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:48.393439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-462773df-52cf-4982-bd9f-ce184a3fdbb3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:48.393886 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-462773df-52cf-4982-bd9f-ce184a3fdbb3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:48.394652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-462773df-52cf-4982-bd9f-ce184a3fdbb3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:48.395324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-462773df-52cf-4982-bd9f-ce184a3fdbb3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:48.626923 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-462773df-52cf-4982-bd9f-ce184a3fdbb3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:48.634169 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f5dd25f8-dabc-4889-a426-4b28e94cc1d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "POST /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/action" status: 202 len: 0 microversion: 2.1 time: 0.783787 Jul 25 12:16:48.635364 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 160/319] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:16:47 2022] POST /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/action => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:16:48.644672 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-8c10dfd5-e019-43ed-bce6-5a9170144672 req-83c9774d-2771-4a2b-a781-417c51f3fbe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6facc5-40af-42cb-80fe-268e5a380a6b", "tag": "18e2de81-a509-4850-99c1-f87dfe2e51c2"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:48.645659 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-462773df-52cf-4982-bd9f-ce184a3fdbb3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:48.651188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-462773df-52cf-4982-bd9f-ce184a3fdbb3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:48.652634 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-462773df-52cf-4982-bd9f-ce184a3fdbb3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.270253 Jul 25 12:16:48.665243 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-8c10dfd5-e019-43ed-bce6-5a9170144672 req-83c9774d-2771-4a2b-a781-417c51f3fbe3 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:48.665780 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-8c10dfd5-e019-43ed-bce6-5a9170144672 req-83c9774d-2771-4a2b-a781-417c51f3fbe3 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:48.667030 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 160/320] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:16:48 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:16:48.672125 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-16902f60-61ab-44ec-841e-1f37f4b664b8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:48.673659 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-16902f60-61ab-44ec-841e-1f37f4b664b8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:48.687596 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:48.689945 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-8c10dfd5-e019-43ed-bce6-5a9170144672 req-83c9774d-2771-4a2b-a781-417c51f3fbe3 service nova] Creating event network-changed:18e2de81-a509-4850-99c1-f87dfe2e51c2 for instance 5d6facc5-40af-42cb-80fe-268e5a380a6b on hv-cinder-79760 Jul 25 12:16:48.690117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16902f60-61ab-44ec-841e-1f37f4b664b8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:48.690608 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16902f60-61ab-44ec-841e-1f37f4b664b8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:48.691437 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16902f60-61ab-44ec-841e-1f37f4b664b8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:48.691994 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-16902f60-61ab-44ec-841e-1f37f4b664b8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:48.696204 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-8c10dfd5-e019-43ed-bce6-5a9170144672 req-83c9774d-2771-4a2b-a781-417c51f3fbe3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057118 Jul 25 12:16:48.697520 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 161/321] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:49.106956 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3197e6da-3622-4689-99fd-b2d1944909ba tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38ada32b-2a99-4325-ac8c-18f3099d39f3"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:49.112810 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3197e6da-3622-4689-99fd-b2d1944909ba tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:49.121832 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3197e6da-3622-4689-99fd-b2d1944909ba tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:49.122607 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3197e6da-3622-4689-99fd-b2d1944909ba tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:49.123427 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3197e6da-3622-4689-99fd-b2d1944909ba tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:49.124044 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3197e6da-3622-4689-99fd-b2d1944909ba tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:49.172641 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-16902f60-61ab-44ec-841e-1f37f4b664b8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:49.184788 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-16902f60-61ab-44ec-841e-1f37f4b664b8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1640 microversion: 2.1 time: 0.516352 Jul 25 12:16:49.186427 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 161/322] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:48 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1640 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:49.420494 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e04d915c-1d9a-4188-867e-8032761c5309 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:49.421535 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e04d915c-1d9a-4188-867e-8032761c5309 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:49.429073 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e04d915c-1d9a-4188-867e-8032761c5309 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:49.430593 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e04d915c-1d9a-4188-867e-8032761c5309 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:49.431704 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e04d915c-1d9a-4188-867e-8032761c5309 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:49.432679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e04d915c-1d9a-4188-867e-8032761c5309 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:49.524515 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3197e6da-3622-4689-99fd-b2d1944909ba tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "POST /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426649 Jul 25 12:16:49.525424 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 162/323] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:16:49 2022] POST /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:49.695566 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e04d915c-1d9a-4188-867e-8032761c5309 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:49.697509 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-befb52b1-a79b-4984-af19-f0760a701d38 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:49.698784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-befb52b1-a79b-4984-af19-f0760a701d38 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:49.703439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e04d915c-1d9a-4188-867e-8032761c5309 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.305030 Jul 25 12:16:49.707660 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 162/324] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:49 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:49.716046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-befb52b1-a79b-4984-af19-f0760a701d38 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:49.716619 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-befb52b1-a79b-4984-af19-f0760a701d38 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:49.718959 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-befb52b1-a79b-4984-af19-f0760a701d38 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:49.720034 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-befb52b1-a79b-4984-af19-f0760a701d38 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:49.911138 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-befb52b1-a79b-4984-af19-f0760a701d38 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:49.941320 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-befb52b1-a79b-4984-af19-f0760a701d38 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:49.944236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-befb52b1-a79b-4984-af19-f0760a701d38 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:49.951472 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-befb52b1-a79b-4984-af19-f0760a701d38 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.262481 Jul 25 12:16:49.967724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 163/325] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:16:49 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:16:50.505915 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8e4d3623-1644-4ee3-96cb-eb66e5d8f429 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:50.506885 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8e4d3623-1644-4ee3-96cb-eb66e5d8f429 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:50.514785 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e4d3623-1644-4ee3-96cb-eb66e5d8f429 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:50.515510 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e4d3623-1644-4ee3-96cb-eb66e5d8f429 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:50.516512 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e4d3623-1644-4ee3-96cb-eb66e5d8f429 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:50.517139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e4d3623-1644-4ee3-96cb-eb66e5d8f429 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:50.543636 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8e4d3623-1644-4ee3-96cb-eb66e5d8f429 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/ips" status: 200 len: 150 microversion: 2.1 time: 0.041853 Jul 25 12:16:50.551654 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 163/326] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Jul 25 12:16:50 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:50.731481 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-63d8329b-5227-46b1-82c0-1ea0bc0139dd tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:50.733069 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-63d8329b-5227-46b1-82c0-1ea0bc0139dd tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:50.748949 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-63d8329b-5227-46b1-82c0-1ea0bc0139dd tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:50.750929 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-63d8329b-5227-46b1-82c0-1ea0bc0139dd tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:50.757309 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-63d8329b-5227-46b1-82c0-1ea0bc0139dd tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:50.758341 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-63d8329b-5227-46b1-82c0-1ea0bc0139dd tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:50.965856 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-63d8329b-5227-46b1-82c0-1ea0bc0139dd tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:50.978297 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-162d16f3-f312-413a-a38b-39de727cf0b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:50.979238 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-162d16f3-f312-413a-a38b-39de727cf0b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:50.981111 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-63d8329b-5227-46b1-82c0-1ea0bc0139dd tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.254361 Jul 25 12:16:50.982273 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 164/327] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:50 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:51.002865 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-162d16f3-f312-413a-a38b-39de727cf0b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:51.003600 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-162d16f3-f312-413a-a38b-39de727cf0b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:51.013463 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-162d16f3-f312-413a-a38b-39de727cf0b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:51.014235 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-162d16f3-f312-413a-a38b-39de727cf0b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:51.229618 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-162d16f3-f312-413a-a38b-39de727cf0b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:51.239535 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-162d16f3-f312-413a-a38b-39de727cf0b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:51.241323 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-162d16f3-f312-413a-a38b-39de727cf0b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:51.242675 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-162d16f3-f312-413a-a38b-39de727cf0b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.268709 Jul 25 12:16:51.256414 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 164/328] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:16:50 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:16:52.010761 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a4b4bc7b-5cc0-48e9-bf84-2fe70156a083 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:52.015357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a4b4bc7b-5cc0-48e9-bf84-2fe70156a083 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:52.028470 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4b4bc7b-5cc0-48e9-bf84-2fe70156a083 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:52.030567 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4b4bc7b-5cc0-48e9-bf84-2fe70156a083 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:52.034903 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4b4bc7b-5cc0-48e9-bf84-2fe70156a083 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:52.035565 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a4b4bc7b-5cc0-48e9-bf84-2fe70156a083 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:52.215643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a4b4bc7b-5cc0-48e9-bf84-2fe70156a083 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:52.225827 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a4b4bc7b-5cc0-48e9-bf84-2fe70156a083 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.226261 Jul 25 12:16:52.239727 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 165/329] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:51 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:52.243592 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d81c063f-d6f5-4822-bd6a-cc6faab3cc47 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "816e15b4-639a-48ea-928b-c639df47cdf7"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:52.248167 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d81c063f-d6f5-4822-bd6a-cc6faab3cc47 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:52.261633 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d81c063f-d6f5-4822-bd6a-cc6faab3cc47 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:52.262490 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d81c063f-d6f5-4822-bd6a-cc6faab3cc47 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:52.263916 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d81c063f-d6f5-4822-bd6a-cc6faab3cc47 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:52.265115 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d81c063f-d6f5-4822-bd6a-cc6faab3cc47 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:52.282114 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1d380ed4-0484-4877-a049-5b77477ad17f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:52.283823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1d380ed4-0484-4877-a049-5b77477ad17f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:52.314009 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d380ed4-0484-4877-a049-5b77477ad17f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:52.314784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d380ed4-0484-4877-a049-5b77477ad17f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:52.315742 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d380ed4-0484-4877-a049-5b77477ad17f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:52.316288 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1d380ed4-0484-4877-a049-5b77477ad17f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:52.646943 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1d380ed4-0484-4877-a049-5b77477ad17f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:52.659167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1d380ed4-0484-4877-a049-5b77477ad17f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:52.661384 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1d380ed4-0484-4877-a049-5b77477ad17f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:52.663953 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1d380ed4-0484-4877-a049-5b77477ad17f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.385990 Jul 25 12:16:52.665508 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 166/330] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:16:52 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:16:52.768407 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d81c063f-d6f5-4822-bd6a-cc6faab3cc47 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "POST /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.530447 Jul 25 12:16:52.774312 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 165/331] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:16:52 2022] POST /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:16:53.246757 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3315fc14-6c08-4143-93f6-5adde944f2eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:53.247370 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3315fc14-6c08-4143-93f6-5adde944f2eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:53.266035 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3315fc14-6c08-4143-93f6-5adde944f2eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:53.266035 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3315fc14-6c08-4143-93f6-5adde944f2eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:53.266035 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3315fc14-6c08-4143-93f6-5adde944f2eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:53.266035 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3315fc14-6c08-4143-93f6-5adde944f2eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:53.434807 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3315fc14-6c08-4143-93f6-5adde944f2eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:53.444188 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3315fc14-6c08-4143-93f6-5adde944f2eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.201405 Jul 25 12:16:53.445922 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 167/332] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:53 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:53.692237 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d252b310-a07d-471d-829f-5607b8b4605d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:53.693579 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d252b310-a07d-471d-829f-5607b8b4605d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:53.700367 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d252b310-a07d-471d-829f-5607b8b4605d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:53.701021 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d252b310-a07d-471d-829f-5607b8b4605d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:53.701956 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d252b310-a07d-471d-829f-5607b8b4605d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:53.702559 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d252b310-a07d-471d-829f-5607b8b4605d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:53.901238 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d252b310-a07d-471d-829f-5607b8b4605d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:53.911371 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d252b310-a07d-471d-829f-5607b8b4605d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:53.913429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d252b310-a07d-471d-829f-5607b8b4605d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:53.915138 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d252b310-a07d-471d-829f-5607b8b4605d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.228492 Jul 25 12:16:53.916434 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 166/333] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:16:53 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:16:54.469157 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c242b28f-2f68-4228-aac7-b29fc5fb3b4b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:54.470365 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c242b28f-2f68-4228-aac7-b29fc5fb3b4b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:54.477515 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c242b28f-2f68-4228-aac7-b29fc5fb3b4b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:54.478050 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c242b28f-2f68-4228-aac7-b29fc5fb3b4b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:54.478902 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c242b28f-2f68-4228-aac7-b29fc5fb3b4b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:54.479416 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c242b28f-2f68-4228-aac7-b29fc5fb3b4b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:54.630193 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c242b28f-2f68-4228-aac7-b29fc5fb3b4b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:54.638755 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c242b28f-2f68-4228-aac7-b29fc5fb3b4b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.173528 Jul 25 12:16:54.639936 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 168/334] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:54 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:54.940152 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f30e769f-467b-4974-bc49-3fccb13e945f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:54.941479 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f30e769f-467b-4974-bc49-3fccb13e945f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:54.949644 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f30e769f-467b-4974-bc49-3fccb13e945f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:54.950596 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f30e769f-467b-4974-bc49-3fccb13e945f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:54.951649 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f30e769f-467b-4974-bc49-3fccb13e945f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:54.952301 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f30e769f-467b-4974-bc49-3fccb13e945f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:55.001955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:55.166853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f30e769f-467b-4974-bc49-3fccb13e945f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:55.175003 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f30e769f-467b-4974-bc49-3fccb13e945f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:55.176693 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f30e769f-467b-4974-bc49-3fccb13e945f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:55.178123 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f30e769f-467b-4974-bc49-3fccb13e945f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.243648 Jul 25 12:16:55.178678 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 167/335] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:16:54 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:16:55.661195 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b8b1d1d5-18e6-4b91-bbb2-0077a986863d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:55.662560 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b8b1d1d5-18e6-4b91-bbb2-0077a986863d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:55.669449 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8b1d1d5-18e6-4b91-bbb2-0077a986863d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:55.670173 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8b1d1d5-18e6-4b91-bbb2-0077a986863d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:55.671166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8b1d1d5-18e6-4b91-bbb2-0077a986863d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:55.671703 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8b1d1d5-18e6-4b91-bbb2-0077a986863d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:55.817627 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b8b1d1d5-18e6-4b91-bbb2-0077a986863d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:55.825514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b8b1d1d5-18e6-4b91-bbb2-0077a986863d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.168872 Jul 25 12:16:55.826078 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 169/336] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:55 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:56.205242 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6a454c11-3d0f-47e7-ab42-bd3b817de4b0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:56.206430 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6a454c11-3d0f-47e7-ab42-bd3b817de4b0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:56.223336 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a454c11-3d0f-47e7-ab42-bd3b817de4b0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:56.225407 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a454c11-3d0f-47e7-ab42-bd3b817de4b0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:56.226994 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a454c11-3d0f-47e7-ab42-bd3b817de4b0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:56.227605 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a454c11-3d0f-47e7-ab42-bd3b817de4b0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:56.520977 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6a454c11-3d0f-47e7-ab42-bd3b817de4b0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:56.532087 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6a454c11-3d0f-47e7-ab42-bd3b817de4b0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:56.535722 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6a454c11-3d0f-47e7-ab42-bd3b817de4b0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:56.537078 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6a454c11-3d0f-47e7-ab42-bd3b817de4b0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.337396 Jul 25 12:16:56.537814 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 168/337] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:16:56 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:16:56.849228 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5844bfca-319e-4012-aaf3-f48c484c4e2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:56.850769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5844bfca-319e-4012-aaf3-f48c484c4e2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:56.861178 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5844bfca-319e-4012-aaf3-f48c484c4e2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:56.863323 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5844bfca-319e-4012-aaf3-f48c484c4e2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:56.864397 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5844bfca-319e-4012-aaf3-f48c484c4e2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:56.865027 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5844bfca-319e-4012-aaf3-f48c484c4e2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:57.125764 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5844bfca-319e-4012-aaf3-f48c484c4e2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:57.135923 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5844bfca-319e-4012-aaf3-f48c484c4e2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.291121 Jul 25 12:16:57.136956 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 170/338] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:56 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:57.566052 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-377db494-91fd-4e9c-a21b-98a20a349f67 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:57.567383 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-377db494-91fd-4e9c-a21b-98a20a349f67 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:57.579284 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-377db494-91fd-4e9c-a21b-98a20a349f67 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:57.580061 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-377db494-91fd-4e9c-a21b-98a20a349f67 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:57.581362 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-377db494-91fd-4e9c-a21b-98a20a349f67 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:57.582054 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-377db494-91fd-4e9c-a21b-98a20a349f67 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:57.748554 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-377db494-91fd-4e9c-a21b-98a20a349f67 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:57.758392 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-377db494-91fd-4e9c-a21b-98a20a349f67 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:57.760421 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-377db494-91fd-4e9c-a21b-98a20a349f67 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:57.761709 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-377db494-91fd-4e9c-a21b-98a20a349f67 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.202389 Jul 25 12:16:57.778715 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 169/339] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:16:57 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:16:58.160379 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4d5c0e4f-3753-467d-af79-2516667d9c7d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:58.161682 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4d5c0e4f-3753-467d-af79-2516667d9c7d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:58.169727 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d5c0e4f-3753-467d-af79-2516667d9c7d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:58.171361 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d5c0e4f-3753-467d-af79-2516667d9c7d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:58.172434 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d5c0e4f-3753-467d-af79-2516667d9c7d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:58.173121 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d5c0e4f-3753-467d-af79-2516667d9c7d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:58.387019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4d5c0e4f-3753-467d-af79-2516667d9c7d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:58.401765 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4d5c0e4f-3753-467d-af79-2516667d9c7d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.245225 Jul 25 12:16:58.403005 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 171/340] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:58 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:16:58.543241 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-741f0f49-1baa-4750-ab96-49a1e2b0306c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:58.551054 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-741f0f49-1baa-4750-ab96-49a1e2b0306c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:58.551721 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-741f0f49-1baa-4750-ab96-49a1e2b0306c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:58.624872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-741f0f49-1baa-4750-ab96-49a1e2b0306c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Going to try to stop instance {{(pid=117776) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 12:16:58.689482 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-741f0f49-1baa-4750-ab96-49a1e2b0306c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "POST /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/action" status: 202 len: 0 microversion: 2.1 time: 0.149115 Jul 25 12:16:58.690968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 170/341] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:16:58 2022] POST /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:16:58.698487 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9df7b9ee-2caf-4e4f-81e2-c841152bc407 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:58.699315 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9df7b9ee-2caf-4e4f-81e2-c841152bc407 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:58.709017 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9df7b9ee-2caf-4e4f-81e2-c841152bc407 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:58.710010 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9df7b9ee-2caf-4e4f-81e2-c841152bc407 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:58.711068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9df7b9ee-2caf-4e4f-81e2-c841152bc407 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:58.712761 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9df7b9ee-2caf-4e4f-81e2-c841152bc407 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:58.788300 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9544d5a8-4834-4f96-809c-e2fa6e9f13b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:58.789158 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9544d5a8-4834-4f96-809c-e2fa6e9f13b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:58.811269 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9544d5a8-4834-4f96-809c-e2fa6e9f13b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:58.811752 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9544d5a8-4834-4f96-809c-e2fa6e9f13b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:58.812525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9544d5a8-4834-4f96-809c-e2fa6e9f13b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:58.812952 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9544d5a8-4834-4f96-809c-e2fa6e9f13b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:58.884594 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9df7b9ee-2caf-4e4f-81e2-c841152bc407 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:58.911471 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9df7b9ee-2caf-4e4f-81e2-c841152bc407 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.200486 Jul 25 12:16:58.923850 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 172/342] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:58 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:59.053344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9544d5a8-4834-4f96-809c-e2fa6e9f13b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:59.064007 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9544d5a8-4834-4f96-809c-e2fa6e9f13b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:59.068636 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9544d5a8-4834-4f96-809c-e2fa6e9f13b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:59.070211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9544d5a8-4834-4f96-809c-e2fa6e9f13b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.287779 Jul 25 12:16:59.070932 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 171/343] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:16:58 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:16:59.433680 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5cb89318-e269-40e5-9986-5b9c67b9ba0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:59.434983 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5cb89318-e269-40e5-9986-5b9c67b9ba0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:59.442573 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5cb89318-e269-40e5-9986-5b9c67b9ba0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:59.443027 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5cb89318-e269-40e5-9986-5b9c67b9ba0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:59.444145 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5cb89318-e269-40e5-9986-5b9c67b9ba0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:59.445689 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5cb89318-e269-40e5-9986-5b9c67b9ba0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:59.589799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5cb89318-e269-40e5-9986-5b9c67b9ba0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:16:59.597956 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5cb89318-e269-40e5-9986-5b9c67b9ba0e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1502 microversion: 2.1 time: 0.168293 Jul 25 12:16:59.598784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 173/344] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:59 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:16:59.620460 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-aefcda14-4b50-462f-b25b-eea87a038a64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07cfa149-93dd-44a3-9096-323c64086449"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:59.623290 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-aefcda14-4b50-462f-b25b-eea87a038a64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:59.631155 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aefcda14-4b50-462f-b25b-eea87a038a64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:59.631786 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aefcda14-4b50-462f-b25b-eea87a038a64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:59.632435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aefcda14-4b50-462f-b25b-eea87a038a64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:59.632874 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aefcda14-4b50-462f-b25b-eea87a038a64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:59.656348 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-aefcda14-4b50-462f-b25b-eea87a038a64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] HTTP exception thrown: Cannot 'attach_volume' instance c9644e94-ac1d-497c-868e-36945ba75fa6 while it is in vm_state rescued Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-aefcda14-4b50-462f-b25b-eea87a038a64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Request method failure captured: Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: POST /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6/os-volume_attachments HTTP/1.1 Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 74 Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3ok95f1--OwMYyUO5AGbD5Z4dHg-jMGrNWEmk2P6lT01K8JUrcVV0YVdqEq8o-tTjrUfy5Y7jIVtvlBCIfFf8Cgi4_T5AOp8BBkuL66TB06rqEy43oBVdOKCQsvoVboB9KLGYCm0UW4LDW9mxQW3-OyhTABwIATZuCV3W1wPXNw5dA0 Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 2d9f339447114912b0c92b99e028fbbf Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:16:59.659045 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:16:59.660466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:16:59.660466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:16:59.660466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 2d9f339447114912b0c92b99e028fbbf Jul 25 12:16:59.660466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:16:59.660466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-ServerRescueNegativeTestJSON-1430226500-project Jul 25 12:16:59.660466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:16:59.660466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:16:59.660466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: a766d17b116f498fab07efb69c94e49e Jul 25 12:16:59.660466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1430226500-project Jul 25 12:16:59.660466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Jul 25 12:16:59.660466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {"volumeAttachment": {"volumeId": "07cfa149-93dd-44a3-9096-323c64086449"}} Jul 25 12:16:59.660466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Cannot 'attach_volume' instance c9644e94-ac1d-497c-868e-36945ba75fa6 while it is in vm_state rescued Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'server_id': 'c9644e94-ac1d-497c-868e-36945ba75fa6', 'body': {'volumeAttachment': {'volumeId': '07cfa149-93dd-44a3-9096-323c64086449'}}} Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9644e94-ac1d-497c-868e-36945ba75fa6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:16:59.661147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c9644e94-ac1d-497c-868e-36945ba75fa6 while it is in vm_state rescued Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:16:59.662251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:16:59.663284 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:16:59.663284 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:16:59.663284 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c9644e94-ac1d-497c-868e-36945ba75fa6 while it is in vm_state rescued Jul 25 12:16:59.663284 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:16:59.664817 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-aefcda14-4b50-462f-b25b-eea87a038a64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Returning 409 to user: Cannot 'attach_volume' instance c9644e94-ac1d-497c-868e-36945ba75fa6 while it is in vm_state rescued {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:16:59.665829 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-aefcda14-4b50-462f-b25b-eea87a038a64 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "POST /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049584 Jul 25 12:16:59.666388 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 172/345] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:16:59 2022] POST /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 12:16:59.677916 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7f3ddfe1-e641-4521-ba39-3e9c99b2302e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:16:59.678681 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7f3ddfe1-e641-4521-ba39-3e9c99b2302e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:59.686856 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f3ddfe1-e641-4521-ba39-3e9c99b2302e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:59.687817 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f3ddfe1-e641-4521-ba39-3e9c99b2302e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:59.690292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f3ddfe1-e641-4521-ba39-3e9c99b2302e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:59.691219 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f3ddfe1-e641-4521-ba39-3e9c99b2302e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:59.785987 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7f3ddfe1-e641-4521-ba39-3e9c99b2302e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "POST /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6/action" status: 202 len: 0 microversion: 2.1 time: 0.114144 Jul 25 12:16:59.786625 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 174/346] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:16:59 2022] POST /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:16:59.795689 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e673fad4-59ab-4830-829d-25e9d743ce0a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:59.797137 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e673fad4-59ab-4830-829d-25e9d743ce0a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:59.808497 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e673fad4-59ab-4830-829d-25e9d743ce0a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:59.810455 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e673fad4-59ab-4830-829d-25e9d743ce0a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:59.812626 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e673fad4-59ab-4830-829d-25e9d743ce0a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:59.813528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e673fad4-59ab-4830-829d-25e9d743ce0a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:59.938506 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-229f090c-00ae-4cb3-b142-c02a4fdff50d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:16:59.939273 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-229f090c-00ae-4cb3-b142-c02a4fdff50d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:16:59.959703 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-229f090c-00ae-4cb3-b142-c02a4fdff50d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:59.960469 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-229f090c-00ae-4cb3-b142-c02a4fdff50d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:16:59.975592 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-229f090c-00ae-4cb3-b142-c02a4fdff50d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:16:59.975592 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-229f090c-00ae-4cb3-b142-c02a4fdff50d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:00.210212 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-229f090c-00ae-4cb3-b142-c02a4fdff50d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:00.227109 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-229f090c-00ae-4cb3-b142-c02a4fdff50d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.293432 Jul 25 12:17:00.228319 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 175/347] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:59 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:00.233200 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9bc49881-fb15-4381-a4b9-02b15ac9e1b2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:00.233882 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9bc49881-fb15-4381-a4b9-02b15ac9e1b2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:00.241207 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bc49881-fb15-4381-a4b9-02b15ac9e1b2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:00.241750 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bc49881-fb15-4381-a4b9-02b15ac9e1b2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:00.242605 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bc49881-fb15-4381-a4b9-02b15ac9e1b2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:00.243119 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bc49881-fb15-4381-a4b9-02b15ac9e1b2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:00.248307 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:00.256127 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e673fad4-59ab-4830-829d-25e9d743ce0a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:00.266631 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e673fad4-59ab-4830-829d-25e9d743ce0a tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1510 microversion: 2.1 time: 0.475443 Jul 25 12:17:00.268117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 173/348] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:16:59 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:00.485463 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9bc49881-fb15-4381-a4b9-02b15ac9e1b2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:00.497732 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9bc49881-fb15-4381-a4b9-02b15ac9e1b2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:00.503412 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9bc49881-fb15-4381-a4b9-02b15ac9e1b2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:00.506754 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9bc49881-fb15-4381-a4b9-02b15ac9e1b2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.277349 Jul 25 12:17:00.507374 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 176/349] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:00 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:01.249974 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-575d2cc9-c810-4cfc-b978-e2e07aed5a9b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:01.252054 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-575d2cc9-c810-4cfc-b978-e2e07aed5a9b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:01.260174 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-575d2cc9-c810-4cfc-b978-e2e07aed5a9b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:01.261064 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-575d2cc9-c810-4cfc-b978-e2e07aed5a9b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:01.262109 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-575d2cc9-c810-4cfc-b978-e2e07aed5a9b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:01.262739 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-575d2cc9-c810-4cfc-b978-e2e07aed5a9b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:01.300459 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9bf0a32f-1cd4-443b-ba90-6a5b57f056f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:01.301697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9bf0a32f-1cd4-443b-ba90-6a5b57f056f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:01.308131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bf0a32f-1cd4-443b-ba90-6a5b57f056f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:01.308849 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bf0a32f-1cd4-443b-ba90-6a5b57f056f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:01.309702 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bf0a32f-1cd4-443b-ba90-6a5b57f056f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:01.310371 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9bf0a32f-1cd4-443b-ba90-6a5b57f056f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:01.412659 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-575d2cc9-c810-4cfc-b978-e2e07aed5a9b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:01.421943 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-575d2cc9-c810-4cfc-b978-e2e07aed5a9b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.175703 Jul 25 12:17:01.423596 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 174/350] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:01 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:01.495716 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9bf0a32f-1cd4-443b-ba90-6a5b57f056f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:01.503906 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9bf0a32f-1cd4-443b-ba90-6a5b57f056f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1510 microversion: 2.1 time: 0.207846 Jul 25 12:17:01.504407 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 177/351] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:01 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:01.539622 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e82529dc-ef9f-4464-9171-58bbd2080986 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:01.540552 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e82529dc-ef9f-4464-9171-58bbd2080986 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:01.547259 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e82529dc-ef9f-4464-9171-58bbd2080986 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:01.548011 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e82529dc-ef9f-4464-9171-58bbd2080986 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:01.549009 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e82529dc-ef9f-4464-9171-58bbd2080986 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:01.549641 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e82529dc-ef9f-4464-9171-58bbd2080986 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:01.697213 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e82529dc-ef9f-4464-9171-58bbd2080986 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:01.709929 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e82529dc-ef9f-4464-9171-58bbd2080986 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:01.712008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e82529dc-ef9f-4464-9171-58bbd2080986 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:01.713403 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e82529dc-ef9f-4464-9171-58bbd2080986 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.177610 Jul 25 12:17:01.714135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 175/352] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:01 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:02.446770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9c913666-d8a6-4e0f-aa79-0fbfb3a35207 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:02.448548 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9c913666-d8a6-4e0f-aa79-0fbfb3a35207 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:02.457370 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c913666-d8a6-4e0f-aa79-0fbfb3a35207 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:02.457824 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c913666-d8a6-4e0f-aa79-0fbfb3a35207 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:02.459086 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c913666-d8a6-4e0f-aa79-0fbfb3a35207 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:02.459730 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c913666-d8a6-4e0f-aa79-0fbfb3a35207 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:02.528263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-63ba0ac9-b73e-49bd-81a4-ec51ecc4b233 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:02.529022 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-63ba0ac9-b73e-49bd-81a4-ec51ecc4b233 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:02.536488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63ba0ac9-b73e-49bd-81a4-ec51ecc4b233 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:02.537163 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63ba0ac9-b73e-49bd-81a4-ec51ecc4b233 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:02.538098 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63ba0ac9-b73e-49bd-81a4-ec51ecc4b233 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:02.538750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-63ba0ac9-b73e-49bd-81a4-ec51ecc4b233 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:02.682073 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9c913666-d8a6-4e0f-aa79-0fbfb3a35207 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:02.707478 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9c913666-d8a6-4e0f-aa79-0fbfb3a35207 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.265875 Jul 25 12:17:02.709998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-63ba0ac9-b73e-49bd-81a4-ec51ecc4b233 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:02.718554 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-63ba0ac9-b73e-49bd-81a4-ec51ecc4b233 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1510 microversion: 2.1 time: 0.196843 Jul 25 12:17:02.732146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 176/353] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:02 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:02.735979 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 178/354] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:02 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:02.738492 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-488e3a10-3952-43f4-ab08-388a2959825b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:02.739211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-488e3a10-3952-43f4-ab08-388a2959825b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:02.745835 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-488e3a10-3952-43f4-ab08-388a2959825b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:02.746379 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-488e3a10-3952-43f4-ab08-388a2959825b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:02.747221 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-488e3a10-3952-43f4-ab08-388a2959825b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:02.747777 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-488e3a10-3952-43f4-ab08-388a2959825b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:02.908291 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-488e3a10-3952-43f4-ab08-388a2959825b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:02.916881 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-488e3a10-3952-43f4-ab08-388a2959825b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:02.918719 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-488e3a10-3952-43f4-ab08-388a2959825b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:02.919904 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-488e3a10-3952-43f4-ab08-388a2959825b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.185427 Jul 25 12:17:02.920451 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 177/355] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:02 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:03.741457 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-38449741-b4f8-444f-85bf-bb345597f559 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:03.742305 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8fc2889b-82c3-4131-8935-9702df2c0b5f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:03.743131 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8fc2889b-82c3-4131-8935-9702df2c0b5f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:03.743650 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-38449741-b4f8-444f-85bf-bb345597f559 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:03.749767 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=78 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:03.752271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38449741-b4f8-444f-85bf-bb345597f559 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:03.752416 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fc2889b-82c3-4131-8935-9702df2c0b5f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:03.752720 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fc2889b-82c3-4131-8935-9702df2c0b5f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:03.752923 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38449741-b4f8-444f-85bf-bb345597f559 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:03.753783 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38449741-b4f8-444f-85bf-bb345597f559 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:03.753957 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fc2889b-82c3-4131-8935-9702df2c0b5f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:03.754339 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38449741-b4f8-444f-85bf-bb345597f559 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:03.754558 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8fc2889b-82c3-4131-8935-9702df2c0b5f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:03.933661 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-38449741-b4f8-444f-85bf-bb345597f559 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:03.934300 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8fc2889b-82c3-4131-8935-9702df2c0b5f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:03.942724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-38449741-b4f8-444f-85bf-bb345597f559 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1510 microversion: 2.1 time: 0.204978 Jul 25 12:17:03.947129 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 179/356] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:03 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:03.952104 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ff48a774-e80f-47f0-a727-26a9c82cdba7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:03.952717 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ff48a774-e80f-47f0-a727-26a9c82cdba7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:03.953236 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8fc2889b-82c3-4131-8935-9702df2c0b5f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.215104 Jul 25 12:17:03.967740 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff48a774-e80f-47f0-a727-26a9c82cdba7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:03.967956 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 178/357] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:03 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:03.968051 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff48a774-e80f-47f0-a727-26a9c82cdba7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:03.968051 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff48a774-e80f-47f0-a727-26a9c82cdba7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:03.968051 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ff48a774-e80f-47f0-a727-26a9c82cdba7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:04.099317 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ff48a774-e80f-47f0-a727-26a9c82cdba7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:04.108275 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ff48a774-e80f-47f0-a727-26a9c82cdba7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:04.110054 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ff48a774-e80f-47f0-a727-26a9c82cdba7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:04.112205 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ff48a774-e80f-47f0-a727-26a9c82cdba7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.167931 Jul 25 12:17:04.112911 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 180/358] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:03 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:04.964699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c1b598e3-4255-4241-a4df-2e9040aec6c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:04.965355 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c1b598e3-4255-4241-a4df-2e9040aec6c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:04.972994 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1b598e3-4255-4241-a4df-2e9040aec6c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:04.973481 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1b598e3-4255-4241-a4df-2e9040aec6c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:04.974542 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1b598e3-4255-4241-a4df-2e9040aec6c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:04.975044 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1b598e3-4255-4241-a4df-2e9040aec6c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:04.976902 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a9cbd135-b0ec-45a5-a581-a7ae39a546b2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:04.977521 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a9cbd135-b0ec-45a5-a581-a7ae39a546b2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:04.987519 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9cbd135-b0ec-45a5-a581-a7ae39a546b2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:04.987998 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9cbd135-b0ec-45a5-a581-a7ae39a546b2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:04.988770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9cbd135-b0ec-45a5-a581-a7ae39a546b2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:04.989205 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a9cbd135-b0ec-45a5-a581-a7ae39a546b2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:05.129490 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a9cbd135-b0ec-45a5-a581-a7ae39a546b2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:05.137443 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c1b598e3-4255-4241-a4df-2e9040aec6c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:05.138181 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a9cbd135-b0ec-45a5-a581-a7ae39a546b2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.166662 Jul 25 12:17:05.153164 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 181/359] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:04 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:05.160369 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c1b598e3-4255-4241-a4df-2e9040aec6c7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1510 microversion: 2.1 time: 0.199560 Jul 25 12:17:05.160567 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1c85785c-9a2c-408b-afbe-c16ec3bf75db tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:05.161160 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1c85785c-9a2c-408b-afbe-c16ec3bf75db tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:05.167323 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c85785c-9a2c-408b-afbe-c16ec3bf75db tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:05.168054 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c85785c-9a2c-408b-afbe-c16ec3bf75db tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:05.169222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c85785c-9a2c-408b-afbe-c16ec3bf75db tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:05.169902 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c85785c-9a2c-408b-afbe-c16ec3bf75db tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:05.176485 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 179/360] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:04 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:05.306896 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1c85785c-9a2c-408b-afbe-c16ec3bf75db tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:05.315762 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1c85785c-9a2c-408b-afbe-c16ec3bf75db tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:05.317320 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1c85785c-9a2c-408b-afbe-c16ec3bf75db tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:05.318557 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1c85785c-9a2c-408b-afbe-c16ec3bf75db tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.162945 Jul 25 12:17:05.319145 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 182/361] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:05 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:06.160896 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a555f007-cb10-491c-9893-f95dfb1ecf15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:06.161573 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a555f007-cb10-491c-9893-f95dfb1ecf15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:06.178897 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a555f007-cb10-491c-9893-f95dfb1ecf15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:06.179758 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a555f007-cb10-491c-9893-f95dfb1ecf15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:06.180783 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a555f007-cb10-491c-9893-f95dfb1ecf15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:06.181498 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a555f007-cb10-491c-9893-f95dfb1ecf15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:06.185009 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-276afd74-fe0a-46d6-8a5b-c4e6d27951f6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:06.185632 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-276afd74-fe0a-46d6-8a5b-c4e6d27951f6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:06.194069 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-276afd74-fe0a-46d6-8a5b-c4e6d27951f6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:06.194580 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-276afd74-fe0a-46d6-8a5b-c4e6d27951f6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:06.195813 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-276afd74-fe0a-46d6-8a5b-c4e6d27951f6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:06.196465 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-276afd74-fe0a-46d6-8a5b-c4e6d27951f6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:06.356738 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a555f007-cb10-491c-9893-f95dfb1ecf15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:06.365988 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a555f007-cb10-491c-9893-f95dfb1ecf15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.210209 Jul 25 12:17:06.379968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 180/362] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:06 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:06.384179 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-276afd74-fe0a-46d6-8a5b-c4e6d27951f6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:06.384998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bca7be80-9ae4-465b-b0d2-de409d102f55 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:06.385605 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bca7be80-9ae4-465b-b0d2-de409d102f55 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:06.394691 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-276afd74-fe0a-46d6-8a5b-c4e6d27951f6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1510 microversion: 2.1 time: 0.213659 Jul 25 12:17:06.395758 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bca7be80-9ae4-465b-b0d2-de409d102f55 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:06.396379 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bca7be80-9ae4-465b-b0d2-de409d102f55 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:06.397304 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bca7be80-9ae4-465b-b0d2-de409d102f55 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:06.397874 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bca7be80-9ae4-465b-b0d2-de409d102f55 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:06.404463 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 183/363] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:06 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:06.546063 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bca7be80-9ae4-465b-b0d2-de409d102f55 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:06.559193 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bca7be80-9ae4-465b-b0d2-de409d102f55 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:06.563488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bca7be80-9ae4-465b-b0d2-de409d102f55 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:06.567080 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bca7be80-9ae4-465b-b0d2-de409d102f55 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.185682 Jul 25 12:17:06.567838 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 181/364] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:06 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:07.390440 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1a6978b2-85b4-48fd-b93f-63f6f07bd0ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:07.391321 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1a6978b2-85b4-48fd-b93f-63f6f07bd0ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:07.410377 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1a6978b2-85b4-48fd-b93f-63f6f07bd0ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:07.411137 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1a6978b2-85b4-48fd-b93f-63f6f07bd0ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:07.417495 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-238f9bbb-d20e-43a0-9f85-38d5095d6652 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:07.419057 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-238f9bbb-d20e-43a0-9f85-38d5095d6652 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:07.426011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1a6978b2-85b4-48fd-b93f-63f6f07bd0ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:07.430317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-238f9bbb-d20e-43a0-9f85-38d5095d6652 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:07.430765 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-238f9bbb-d20e-43a0-9f85-38d5095d6652 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:07.431535 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-238f9bbb-d20e-43a0-9f85-38d5095d6652 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:07.431994 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-238f9bbb-d20e-43a0-9f85-38d5095d6652 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:07.432689 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1a6978b2-85b4-48fd-b93f-63f6f07bd0ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:07.624442 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1a6978b2-85b4-48fd-b93f-63f6f07bd0ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:07.636341 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1a6978b2-85b4-48fd-b93f-63f6f07bd0ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.250273 Jul 25 12:17:07.637440 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 184/365] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:07 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:07.652885 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4b296baf-cba3-49bb-b424-d08a057231dd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:07.653507 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4b296baf-cba3-49bb-b424-d08a057231dd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:07.661026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4b296baf-cba3-49bb-b424-d08a057231dd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:07.661475 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4b296baf-cba3-49bb-b424-d08a057231dd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:07.662285 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4b296baf-cba3-49bb-b424-d08a057231dd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:07.662719 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4b296baf-cba3-49bb-b424-d08a057231dd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:07.671069 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-238f9bbb-d20e-43a0-9f85-38d5095d6652 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:07.680682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-238f9bbb-d20e-43a0-9f85-38d5095d6652 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1516 microversion: 2.1 time: 0.267107 Jul 25 12:17:07.691970 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 182/366] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:07 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1516 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:07.880991 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4b296baf-cba3-49bb-b424-d08a057231dd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:07.890437 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4b296baf-cba3-49bb-b424-d08a057231dd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:07.892370 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4b296baf-cba3-49bb-b424-d08a057231dd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:07.894033 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4b296baf-cba3-49bb-b424-d08a057231dd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.255273 Jul 25 12:17:07.910978 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 185/367] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:07 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:08.658321 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dfe28389-4abc-4ab0-88d8-970b5e64233d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:08.658931 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dfe28389-4abc-4ab0-88d8-970b5e64233d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:08.666039 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dfe28389-4abc-4ab0-88d8-970b5e64233d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:08.666557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dfe28389-4abc-4ab0-88d8-970b5e64233d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:08.667323 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dfe28389-4abc-4ab0-88d8-970b5e64233d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:08.667788 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dfe28389-4abc-4ab0-88d8-970b5e64233d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:08.687989 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:08.811789 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dfe28389-4abc-4ab0-88d8-970b5e64233d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:08.820297 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dfe28389-4abc-4ab0-88d8-970b5e64233d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.166028 Jul 25 12:17:08.821023 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 183/368] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:08 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:08.920081 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-047cdfae-ecf8-4aba-8c20-9edcf9d811e2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:08.920694 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-047cdfae-ecf8-4aba-8c20-9edcf9d811e2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:08.928138 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-047cdfae-ecf8-4aba-8c20-9edcf9d811e2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:08.928593 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-047cdfae-ecf8-4aba-8c20-9edcf9d811e2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:08.929454 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-047cdfae-ecf8-4aba-8c20-9edcf9d811e2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:08.929893 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-047cdfae-ecf8-4aba-8c20-9edcf9d811e2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:09.065429 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-047cdfae-ecf8-4aba-8c20-9edcf9d811e2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:09.074408 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-047cdfae-ecf8-4aba-8c20-9edcf9d811e2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:09.076166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-047cdfae-ecf8-4aba-8c20-9edcf9d811e2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:09.077344 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-047cdfae-ecf8-4aba-8c20-9edcf9d811e2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1743 microversion: 2.20 time: 0.161136 Jul 25 12:17:09.077900 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 186/369] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:08 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:09.182112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dad5e6e7-e2ce-4594-b71a-3adb3e046325 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Action: 'create', calling method: .version_select at 0x7f942e1e3dc0>, body: {"keypair": {"name": "tempest-keypair-1995308901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXFSfRLnQAAve/oqVi3ZNSF6RwPuKHwr4QWMgqLI/pK17BNURUy+WcM9Ui4rAm7UlBYWTG7D1MUjiKvMeJGuhKPfOJt+JtPDHrTYn4mEHaQe9BAvQLQvMSyRXTQOwO9VA=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:09.198199 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-dad5e6e7-e2ce-4594-b71a-3adb3e046325 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Getting quotas for project 2d9f339447114912b0c92b99e028fbbf. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:17:09.202063 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-dad5e6e7-e2ce-4594-b71a-3adb3e046325 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Getting quotas for user a766d17b116f498fab07efb69c94e49e and project 2d9f339447114912b0c92b99e028fbbf. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:17:09.209043 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c79a5353-6223-435f-9f3d-8cfcbb750599 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Action: 'create', calling method: .version_select at 0x7f942c589820>, body: {"keypair": {"name": "tempest-keypair-1319134391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGz9DnJ9QIJa/NTGCwfQzmDBgMLNpu2+GFEFLLuvddc6Li+W5udwUqcNAz0wj/haMJQvDlBoDADFYeohzr0uKWfvPQoqHWsJCE/MCi9WFR+bnLGBLf+j7HauG7cGYvPPnw=="}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:09.228000 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-c79a5353-6223-435f-9f3d-8cfcbb750599 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:17:09.229748 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dad5e6e7-e2ce-4594-b71a-3adb3e046325 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051334 Jul 25 12:17:09.230337 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 184/370] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Jul 25 12:17:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:17:09.233067 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-c79a5353-6223-435f-9f3d-8cfcbb750599 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for user 3848eae5b8df48eb9816ba0d7485f7c0 and project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:17:09.256984 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c79a5353-6223-435f-9f3d-8cfcbb750599 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051643 Jul 25 12:17:09.258127 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 187/371] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Jul 25 12:17:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:17:09.841306 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c5b90c1b-f991-45f9-a64e-9647725c85a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:09.842114 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c5b90c1b-f991-45f9-a64e-9647725c85a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:09.849896 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c5b90c1b-f991-45f9-a64e-9647725c85a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:09.850260 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c5b90c1b-f991-45f9-a64e-9647725c85a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:09.851019 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c5b90c1b-f991-45f9-a64e-9647725c85a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:09.851450 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c5b90c1b-f991-45f9-a64e-9647725c85a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:09.984177 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c5b90c1b-f991-45f9-a64e-9647725c85a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:09.992129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c5b90c1b-f991-45f9-a64e-9647725c85a9 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.155607 Jul 25 12:17:09.992694 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 185/372] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:09 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:10.108147 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-171624a8-4dfe-4fbe-871b-a04145121530 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:10.108680 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-171624a8-4dfe-4fbe-871b-a04145121530 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:10.115792 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-171624a8-4dfe-4fbe-871b-a04145121530 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:10.116322 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-171624a8-4dfe-4fbe-871b-a04145121530 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:10.117367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-171624a8-4dfe-4fbe-871b-a04145121530 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:10.117899 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-171624a8-4dfe-4fbe-871b-a04145121530 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:10.471018 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-171624a8-4dfe-4fbe-871b-a04145121530 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:10.481095 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-171624a8-4dfe-4fbe-871b-a04145121530 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:10.485471 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-171624a8-4dfe-4fbe-871b-a04145121530 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:10.486669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-171624a8-4dfe-4fbe-871b-a04145121530 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1743 microversion: 2.20 time: 0.383748 Jul 25 12:17:10.491659 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 188/373] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:10 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1743 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:11.015955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-055645b1-17c3-499e-8ba7-86d5a27987c5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:11.017735 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-055645b1-17c3-499e-8ba7-86d5a27987c5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:11.034892 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-055645b1-17c3-499e-8ba7-86d5a27987c5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:11.035519 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-055645b1-17c3-499e-8ba7-86d5a27987c5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:11.036845 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-055645b1-17c3-499e-8ba7-86d5a27987c5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:11.037376 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-055645b1-17c3-499e-8ba7-86d5a27987c5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:11.136448 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1048573405", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5fd11542-87b8-48c3-9db2-c824ddc0af2f"}], "security_groups": [{"name": "tempest-securitygroup--216183762"}], "key_name": "tempest-keypair-1995308901", "user_data": "}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:11.271413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-055645b1-17c3-499e-8ba7-86d5a27987c5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:11.283233 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-055645b1-17c3-499e-8ba7-86d5a27987c5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.272237 Jul 25 12:17:11.283863 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 186/374] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:11 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:11.353881 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] validate_networks() for [('5fd11542-87b8-48c3-9db2-c824ddc0af2f', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:17:11.513792 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e77cc54d-32b2-4ac3-a4e2-ad67c1c9e838 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:11.514683 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e77cc54d-32b2-4ac3-a4e2-ad67c1c9e838 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:11.527232 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e77cc54d-32b2-4ac3-a4e2-ad67c1c9e838 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:11.527881 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e77cc54d-32b2-4ac3-a4e2-ad67c1c9e838 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:11.528753 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e77cc54d-32b2-4ac3-a4e2-ad67c1c9e838 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:11.529359 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e77cc54d-32b2-4ac3-a4e2-ad67c1c9e838 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:11.684337 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e77cc54d-32b2-4ac3-a4e2-ad67c1c9e838 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:11.694049 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e77cc54d-32b2-4ac3-a4e2-ad67c1c9e838 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:11.695720 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e77cc54d-32b2-4ac3-a4e2-ad67c1c9e838 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:11.697447 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e77cc54d-32b2-4ac3-a4e2-ad67c1c9e838 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1743 microversion: 2.20 time: 0.187960 Jul 25 12:17:11.698163 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 187/375] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:11 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1743 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:11.703195 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1228174412", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6bc64d3-b55c-4e64-a050-b439cd834684"}], "security_groups": [{"name": "tempest-securitygroup--1528494909"}], "key_name": "tempest-keypair-1319134391", "user_data": "}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:11.823837 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] validate_networks() for [('b6bc64d3-b55c-4e64-a050-b439cd834684', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:17:11.830069 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:17:11.830493 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:17:11.830959 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:17:11.831358 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:17:11.832414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:17:11.842611 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:11.843723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:11.845090 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:11.845519 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:11.866136 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Getting quotas for project 2d9f339447114912b0c92b99e028fbbf. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:17:11.871336 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Getting quotas for user a766d17b116f498fab07efb69c94e49e and project 2d9f339447114912b0c92b99e028fbbf. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:17:11.885151 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:17:11.887480 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:17:11.942270 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b6f71d88-c463-4bc7-ab99-3d345368bbf6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.810206 Jul 25 12:17:11.943957 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 189/376] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:17:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:17:11.956016 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0568fef1-9317-4361-a66c-57ecb5d9acb3 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:11.957016 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0568fef1-9317-4361-a66c-57ecb5d9acb3 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:12.019188 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0568fef1-9317-4361-a66c-57ecb5d9acb3 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:12.028820 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0568fef1-9317-4361-a66c-57ecb5d9acb3 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1246 microversion: 2.1 time: 0.078778 Jul 25 12:17:12.029388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 190/377] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:11 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:12.250235 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:17:12.251255 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:17:12.251666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:17:12.252247 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:17:12.252650 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:17:12.257639 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-f5de2cde-7aeb-4b02-8e82-fc29e608d6a2 req-50b4d918-92bc-4564-8b25-aac0cae0f6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66654721-31e2-48d8-a0ea-c146d277ab47", "name": "network-vif-plugged", "status": "completed", "tag": "d01f3ff0-df08-4605-a057-7920ee080060"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:12.264005 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:12.265155 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:12.267008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:12.267682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:12.270255 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-f5de2cde-7aeb-4b02-8e82-fc29e608d6a2 req-50b4d918-92bc-4564-8b25-aac0cae0f6f4 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:12.270788 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-f5de2cde-7aeb-4b02-8e82-fc29e608d6a2 req-50b4d918-92bc-4564-8b25-aac0cae0f6f4 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:12.284470 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-f5de2cde-7aeb-4b02-8e82-fc29e608d6a2 req-50b4d918-92bc-4564-8b25-aac0cae0f6f4 service nova] Creating event network-vif-plugged:d01f3ff0-df08-4605-a057-7920ee080060 for instance 66654721-31e2-48d8-a0ea-c146d277ab47 on hv-cinder-79760 Jul 25 12:17:12.290365 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-f5de2cde-7aeb-4b02-8e82-fc29e608d6a2 req-50b4d918-92bc-4564-8b25-aac0cae0f6f4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038559 Jul 25 12:17:12.291357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 191/378] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:17:12.293699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:17:12.298798 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for user 3848eae5b8df48eb9816ba0d7485f7c0 and project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:17:12.309219 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5b6b0f21-e5ac-400f-a034-1fe8ca75b9a8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:12.310218 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5b6b0f21-e5ac-400f-a034-1fe8ca75b9a8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:12.312801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:17:12.316684 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:17:12.320003 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b6b0f21-e5ac-400f-a034-1fe8ca75b9a8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:12.320645 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b6b0f21-e5ac-400f-a034-1fe8ca75b9a8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:12.321673 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b6b0f21-e5ac-400f-a034-1fe8ca75b9a8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:12.322566 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5b6b0f21-e5ac-400f-a034-1fe8ca75b9a8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:12.372412 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b448f4a6-fcff-450f-906c-abc7bb66b217 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.672994 Jul 25 12:17:12.373331 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 188/379] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:17:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:17:12.386669 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-308e9561-8307-4b44-9525-db82689569b8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:12.387827 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-308e9561-8307-4b44-9525-db82689569b8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:12.476494 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-308e9561-8307-4b44-9525-db82689569b8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:12.490177 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-308e9561-8307-4b44-9525-db82689569b8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1242 microversion: 2.1 time: 0.108513 Jul 25 12:17:12.501959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 189/380] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:12 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1242 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:12.540922 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5b6b0f21-e5ac-400f-a034-1fe8ca75b9a8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:12.550837 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5b6b0f21-e5ac-400f-a034-1fe8ca75b9a8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.248420 Jul 25 12:17:12.555611 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 192/381] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:12 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:12.724060 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-96746355-c6f4-483b-aaed-d6c5c3f16c0f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:12.724747 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-96746355-c6f4-483b-aaed-d6c5c3f16c0f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:12.737690 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-96746355-c6f4-483b-aaed-d6c5c3f16c0f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:12.738133 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-96746355-c6f4-483b-aaed-d6c5c3f16c0f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:12.740533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-96746355-c6f4-483b-aaed-d6c5c3f16c0f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:12.741006 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-96746355-c6f4-483b-aaed-d6c5c3f16c0f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:12.883469 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-96746355-c6f4-483b-aaed-d6c5c3f16c0f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:12.891667 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-96746355-c6f4-483b-aaed-d6c5c3f16c0f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:12.893255 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-96746355-c6f4-483b-aaed-d6c5c3f16c0f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:12.894413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-96746355-c6f4-483b-aaed-d6c5c3f16c0f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1738 microversion: 2.20 time: 0.176825 Jul 25 12:17:12.894959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 190/382] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:12 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:13.051205 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c4dc4937-de56-4b95-a40f-f7a6b9656f2f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:13.051746 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c4dc4937-de56-4b95-a40f-f7a6b9656f2f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:13.059878 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c4dc4937-de56-4b95-a40f-f7a6b9656f2f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:13.075644 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c4dc4937-de56-4b95-a40f-f7a6b9656f2f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:13.078930 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c4dc4937-de56-4b95-a40f-f7a6b9656f2f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:13.079827 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c4dc4937-de56-4b95-a40f-f7a6b9656f2f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:13.206507 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c4dc4937-de56-4b95-a40f-f7a6b9656f2f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:13.215303 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c4dc4937-de56-4b95-a40f-f7a6b9656f2f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1298 microversion: 2.1 time: 0.168966 Jul 25 12:17:13.216651 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 193/383] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:13 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1298 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:13.515614 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7e24b268-4a50-4cdc-a527-feb760894c6e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:13.516736 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7e24b268-4a50-4cdc-a527-feb760894c6e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:13.523417 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e24b268-4a50-4cdc-a527-feb760894c6e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:13.523891 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e24b268-4a50-4cdc-a527-feb760894c6e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:13.524846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e24b268-4a50-4cdc-a527-feb760894c6e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:13.525431 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e24b268-4a50-4cdc-a527-feb760894c6e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:13.573278 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8fcb781d-22cc-4891-934b-5b9a1354ea69 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:13.574070 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8fcb781d-22cc-4891-934b-5b9a1354ea69 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:13.582175 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8fcb781d-22cc-4891-934b-5b9a1354ea69 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:13.582713 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8fcb781d-22cc-4891-934b-5b9a1354ea69 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:13.583699 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8fcb781d-22cc-4891-934b-5b9a1354ea69 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:13.584179 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8fcb781d-22cc-4891-934b-5b9a1354ea69 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:13.647105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7e24b268-4a50-4cdc-a527-feb760894c6e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:13.654542 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7e24b268-4a50-4cdc-a527-feb760894c6e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1294 microversion: 2.1 time: 0.143715 Jul 25 12:17:13.669539 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 191/384] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:13 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1294 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:13.757374 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8fcb781d-22cc-4891-934b-5b9a1354ea69 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:13.766933 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8fcb781d-22cc-4891-934b-5b9a1354ea69 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.197709 Jul 25 12:17:13.767828 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 194/385] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:13 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:13.919950 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-84f245ae-fdb8-42bc-b55a-5fc26646e959 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:13.920978 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-84f245ae-fdb8-42bc-b55a-5fc26646e959 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:13.931311 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84f245ae-fdb8-42bc-b55a-5fc26646e959 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:13.932165 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84f245ae-fdb8-42bc-b55a-5fc26646e959 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:13.933225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84f245ae-fdb8-42bc-b55a-5fc26646e959 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:13.934366 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-84f245ae-fdb8-42bc-b55a-5fc26646e959 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:14.237437 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6c164640-4fe1-4f75-bfaa-aa1515cc6981 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:14.238052 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6c164640-4fe1-4f75-bfaa-aa1515cc6981 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:14.244340 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c164640-4fe1-4f75-bfaa-aa1515cc6981 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:14.244765 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c164640-4fe1-4f75-bfaa-aa1515cc6981 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:14.256984 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c164640-4fe1-4f75-bfaa-aa1515cc6981 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:14.257418 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6c164640-4fe1-4f75-bfaa-aa1515cc6981 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:14.324542 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6c164640-4fe1-4f75-bfaa-aa1515cc6981 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:14.330079 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84f245ae-fdb8-42bc-b55a-5fc26646e959 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:14.334805 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6c164640-4fe1-4f75-bfaa-aa1515cc6981 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1304 microversion: 2.1 time: 0.101238 Jul 25 12:17:14.335858 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 195/386] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:14 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:14.354551 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84f245ae-fdb8-42bc-b55a-5fc26646e959 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:14.356408 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-84f245ae-fdb8-42bc-b55a-5fc26646e959 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:14.357808 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-84f245ae-fdb8-42bc-b55a-5fc26646e959 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1738 microversion: 2.20 time: 0.442458 Jul 25 12:17:14.358889 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 192/387] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:13 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1738 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:14.676495 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f4182782-9476-4d4f-8ab5-c3fbbcc6d55f tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:14.677813 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f4182782-9476-4d4f-8ab5-c3fbbcc6d55f tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:14.684487 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f4182782-9476-4d4f-8ab5-c3fbbcc6d55f tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:14.685056 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f4182782-9476-4d4f-8ab5-c3fbbcc6d55f tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:14.685920 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f4182782-9476-4d4f-8ab5-c3fbbcc6d55f tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:14.686580 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f4182782-9476-4d4f-8ab5-c3fbbcc6d55f tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:14.692025 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:14.754742 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f4182782-9476-4d4f-8ab5-c3fbbcc6d55f tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:14.762640 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f4182782-9476-4d4f-8ab5-c3fbbcc6d55f tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1300 microversion: 2.1 time: 0.089968 Jul 25 12:17:14.763329 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 196/388] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:14 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:14.795107 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-13d2e393-abe5-46eb-b999-44f6c7389d18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:14.801433 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-13d2e393-abe5-46eb-b999-44f6c7389d18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:14.808332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13d2e393-abe5-46eb-b999-44f6c7389d18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:14.808865 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13d2e393-abe5-46eb-b999-44f6c7389d18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:14.809879 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13d2e393-abe5-46eb-b999-44f6c7389d18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:14.810987 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-13d2e393-abe5-46eb-b999-44f6c7389d18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:15.171770 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-13d2e393-abe5-46eb-b999-44f6c7389d18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:15.181357 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-13d2e393-abe5-46eb-b999-44f6c7389d18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.395011 Jul 25 12:17:15.188755 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 193/389] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:14 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:15.356652 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-48989f74-39db-4cc4-a1b6-5e3760925605 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:15.357444 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-48989f74-39db-4cc4-a1b6-5e3760925605 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:15.371570 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48989f74-39db-4cc4-a1b6-5e3760925605 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:15.372421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48989f74-39db-4cc4-a1b6-5e3760925605 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:15.373701 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48989f74-39db-4cc4-a1b6-5e3760925605 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:15.374086 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48989f74-39db-4cc4-a1b6-5e3760925605 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:15.382473 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b19b10dd-8cb4-475f-9863-a62fd4e05526 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:15.383145 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b19b10dd-8cb4-475f-9863-a62fd4e05526 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:15.385106 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:15.394783 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b19b10dd-8cb4-475f-9863-a62fd4e05526 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:15.404269 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b19b10dd-8cb4-475f-9863-a62fd4e05526 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:15.405392 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b19b10dd-8cb4-475f-9863-a62fd4e05526 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:15.406015 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b19b10dd-8cb4-475f-9863-a62fd4e05526 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:15.587180 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-48989f74-39db-4cc4-a1b6-5e3760925605 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:15.597118 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-48989f74-39db-4cc4-a1b6-5e3760925605 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1371 microversion: 2.1 time: 0.244473 Jul 25 12:17:15.597976 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 197/390] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:15 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:15.699907 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b19b10dd-8cb4-475f-9863-a62fd4e05526 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:15.718104 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b19b10dd-8cb4-475f-9863-a62fd4e05526 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:15.722957 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b19b10dd-8cb4-475f-9863-a62fd4e05526 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:15.724396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b19b10dd-8cb4-475f-9863-a62fd4e05526 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1738 microversion: 2.20 time: 0.345825 Jul 25 12:17:15.752577 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 194/391] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:15 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1738 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:15.788146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-837c7fb3-994c-4fc4-a040-9b547e4e9833 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:15.790501 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-837c7fb3-994c-4fc4-a040-9b547e4e9833 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:15.800971 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-837c7fb3-994c-4fc4-a040-9b547e4e9833 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:15.803684 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-837c7fb3-994c-4fc4-a040-9b547e4e9833 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:15.804799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-837c7fb3-994c-4fc4-a040-9b547e4e9833 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:15.805396 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-837c7fb3-994c-4fc4-a040-9b547e4e9833 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:16.014529 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-837c7fb3-994c-4fc4-a040-9b547e4e9833 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:16.025755 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-837c7fb3-994c-4fc4-a040-9b547e4e9833 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1368 microversion: 2.1 time: 0.244899 Jul 25 12:17:16.026736 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 198/392] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:15 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:16.211110 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-747d0de1-ab4a-4ceb-b193-c6fdd1554af8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:16.212205 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-747d0de1-ab4a-4ceb-b193-c6fdd1554af8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:16.223011 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-747d0de1-ab4a-4ceb-b193-c6fdd1554af8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:16.223760 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-747d0de1-ab4a-4ceb-b193-c6fdd1554af8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:16.224704 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-747d0de1-ab4a-4ceb-b193-c6fdd1554af8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:16.225298 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-747d0de1-ab4a-4ceb-b193-c6fdd1554af8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:16.621443 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e946c337-1bea-4cd6-ad98-55c97b281e76 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:16.622591 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e946c337-1bea-4cd6-ad98-55c97b281e76 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:16.630342 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e946c337-1bea-4cd6-ad98-55c97b281e76 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:16.631282 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e946c337-1bea-4cd6-ad98-55c97b281e76 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:16.635671 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e946c337-1bea-4cd6-ad98-55c97b281e76 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:16.636377 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e946c337-1bea-4cd6-ad98-55c97b281e76 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:16.677606 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-747d0de1-ab4a-4ceb-b193-c6fdd1554af8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:16.694447 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-747d0de1-ab4a-4ceb-b193-c6fdd1554af8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.482057 Jul 25 12:17:16.701004 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 195/393] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:16 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:16.764584 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d02b3848-bb4c-43a9-9ec8-15cbdcb46f20 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:16.765503 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d02b3848-bb4c-43a9-9ec8-15cbdcb46f20 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:16.778852 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d02b3848-bb4c-43a9-9ec8-15cbdcb46f20 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:16.779572 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d02b3848-bb4c-43a9-9ec8-15cbdcb46f20 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:16.780811 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d02b3848-bb4c-43a9-9ec8-15cbdcb46f20 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:16.781400 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d02b3848-bb4c-43a9-9ec8-15cbdcb46f20 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:16.805060 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e946c337-1bea-4cd6-ad98-55c97b281e76 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:16.814347 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e946c337-1bea-4cd6-ad98-55c97b281e76 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1371 microversion: 2.1 time: 0.199158 Jul 25 12:17:16.826184 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 199/394] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:16 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:16.921177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-71bbab79-bf97-41a5-86a0-1400967bc9e4 req-d8a8399f-5bf8-4feb-a876-f4486c2a10b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0", "tag": "01fbcb44-8f5c-4f96-8ed4-469cbfa137f5"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:16.935903 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-71bbab79-bf97-41a5-86a0-1400967bc9e4 req-d8a8399f-5bf8-4feb-a876-f4486c2a10b7 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:16.936556 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-71bbab79-bf97-41a5-86a0-1400967bc9e4 req-d8a8399f-5bf8-4feb-a876-f4486c2a10b7 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:16.954889 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-71bbab79-bf97-41a5-86a0-1400967bc9e4 req-d8a8399f-5bf8-4feb-a876-f4486c2a10b7 service nova] Creating event network-changed:01fbcb44-8f5c-4f96-8ed4-469cbfa137f5 for instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 on hv-cinder-79760 Jul 25 12:17:16.967841 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-71bbab79-bf97-41a5-86a0-1400967bc9e4 req-d8a8399f-5bf8-4feb-a876-f4486c2a10b7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051298 Jul 25 12:17:16.968621 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 200/395] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:17:17.054922 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2cad848c-6489-4acb-ae2a-12cfb5cdedb5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:17.055788 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2cad848c-6489-4acb-ae2a-12cfb5cdedb5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:17.071777 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2cad848c-6489-4acb-ae2a-12cfb5cdedb5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:17.072969 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2cad848c-6489-4acb-ae2a-12cfb5cdedb5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:17.074786 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2cad848c-6489-4acb-ae2a-12cfb5cdedb5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:17.077248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2cad848c-6489-4acb-ae2a-12cfb5cdedb5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:17.079670 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d02b3848-bb4c-43a9-9ec8-15cbdcb46f20 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:17.093059 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d02b3848-bb4c-43a9-9ec8-15cbdcb46f20 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:17.095448 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d02b3848-bb4c-43a9-9ec8-15cbdcb46f20 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:17.103101 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d02b3848-bb4c-43a9-9ec8-15cbdcb46f20 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1738 microversion: 2.20 time: 0.342654 Jul 25 12:17:17.106712 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 196/396] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:16 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1738 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:17.293913 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2cad848c-6489-4acb-ae2a-12cfb5cdedb5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:17.308605 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2cad848c-6489-4acb-ae2a-12cfb5cdedb5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1368 microversion: 2.1 time: 0.257843 Jul 25 12:17:17.310236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 201/397] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:17 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:17.728489 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3a0c02f8-7477-4500-8d3e-950a5ef09ef4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:17.733530 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3a0c02f8-7477-4500-8d3e-950a5ef09ef4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:17.789036 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a0c02f8-7477-4500-8d3e-950a5ef09ef4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:17.790550 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a0c02f8-7477-4500-8d3e-950a5ef09ef4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:17.796897 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a0c02f8-7477-4500-8d3e-950a5ef09ef4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:17.799401 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a0c02f8-7477-4500-8d3e-950a5ef09ef4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:17.836371 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9b41ea7c-ad7d-4743-a5ab-212c6dee639f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:17.837733 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9b41ea7c-ad7d-4743-a5ab-212c6dee639f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:17.852319 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b41ea7c-ad7d-4743-a5ab-212c6dee639f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:17.853043 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b41ea7c-ad7d-4743-a5ab-212c6dee639f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:17.854284 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b41ea7c-ad7d-4743-a5ab-212c6dee639f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:17.854912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9b41ea7c-ad7d-4743-a5ab-212c6dee639f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:18.030712 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9b41ea7c-ad7d-4743-a5ab-212c6dee639f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:18.040103 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9b41ea7c-ad7d-4743-a5ab-212c6dee639f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1371 microversion: 2.1 time: 0.209032 Jul 25 12:17:18.055982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 202/398] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:17 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:18.135019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c463b07d-430d-4447-8c86-4d1ca6c2babe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:18.135922 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c463b07d-430d-4447-8c86-4d1ca6c2babe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:18.145863 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c463b07d-430d-4447-8c86-4d1ca6c2babe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:18.146536 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c463b07d-430d-4447-8c86-4d1ca6c2babe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:18.147643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c463b07d-430d-4447-8c86-4d1ca6c2babe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:18.148528 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c463b07d-430d-4447-8c86-4d1ca6c2babe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:18.339610 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c463b07d-430d-4447-8c86-4d1ca6c2babe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:18.348949 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c463b07d-430d-4447-8c86-4d1ca6c2babe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:18.350665 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c463b07d-430d-4447-8c86-4d1ca6c2babe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:18.352605 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c463b07d-430d-4447-8c86-4d1ca6c2babe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1738 microversion: 2.20 time: 0.221542 Jul 25 12:17:18.360583 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3a0c02f8-7477-4500-8d3e-950a5ef09ef4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:18.367626 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 203/399] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:18 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:18.371973 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3a0c02f8-7477-4500-8d3e-950a5ef09ef4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.654139 Jul 25 12:17:18.373076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c28122bf-0658-4562-addd-8bab198faf32 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:18.373446 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 197/400] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:17 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:18.374715 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c28122bf-0658-4562-addd-8bab198faf32 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:18.383819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c28122bf-0658-4562-addd-8bab198faf32 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:18.384407 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c28122bf-0658-4562-addd-8bab198faf32 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:18.385309 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c28122bf-0658-4562-addd-8bab198faf32 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:18.385846 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c28122bf-0658-4562-addd-8bab198faf32 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:18.542137 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c28122bf-0658-4562-addd-8bab198faf32 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:18.550996 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c28122bf-0658-4562-addd-8bab198faf32 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1368 microversion: 2.1 time: 0.182053 Jul 25 12:17:18.560307 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 204/401] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:18 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:18.997305 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-38a0ff66-8f33-4bc6-ac11-172fa3c358f8 req-1fc4eba3-df99-4324-8925-8f6aecac0961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484cf6bc-2993-476c-ab86-45ac7e109720", "tag": "9251fe67-d381-42a4-95a5-12fffca6f2be"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:19.007791 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-38a0ff66-8f33-4bc6-ac11-172fa3c358f8 req-1fc4eba3-df99-4324-8925-8f6aecac0961 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:19.008228 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-38a0ff66-8f33-4bc6-ac11-172fa3c358f8 req-1fc4eba3-df99-4324-8925-8f6aecac0961 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:19.020048 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-38a0ff66-8f33-4bc6-ac11-172fa3c358f8 req-1fc4eba3-df99-4324-8925-8f6aecac0961 service nova] Creating event network-changed:9251fe67-d381-42a4-95a5-12fffca6f2be for instance 484cf6bc-2993-476c-ab86-45ac7e109720 on hv-cinder-79760 Jul 25 12:17:19.026099 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-38a0ff66-8f33-4bc6-ac11-172fa3c358f8 req-1fc4eba3-df99-4324-8925-8f6aecac0961 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033426 Jul 25 12:17:19.026974 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 198/402] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:17:19.062863 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3b780de3-7443-4fc8-9e91-e9966387025b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:19.063416 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3b780de3-7443-4fc8-9e91-e9966387025b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:19.070197 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b780de3-7443-4fc8-9e91-e9966387025b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:19.070637 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b780de3-7443-4fc8-9e91-e9966387025b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:19.071412 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b780de3-7443-4fc8-9e91-e9966387025b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:19.071877 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3b780de3-7443-4fc8-9e91-e9966387025b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:19.232219 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3b780de3-7443-4fc8-9e91-e9966387025b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:19.241014 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3b780de3-7443-4fc8-9e91-e9966387025b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1371 microversion: 2.1 time: 0.182768 Jul 25 12:17:19.241605 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 205/403] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:19 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:19.377703 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-abd7c824-d508-44f2-b2e6-4f849d541f33 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:19.378308 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-abd7c824-d508-44f2-b2e6-4f849d541f33 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:19.384852 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-abd7c824-d508-44f2-b2e6-4f849d541f33 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:19.385395 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-abd7c824-d508-44f2-b2e6-4f849d541f33 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:19.386276 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-abd7c824-d508-44f2-b2e6-4f849d541f33 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:19.386708 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-abd7c824-d508-44f2-b2e6-4f849d541f33 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:19.394675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-16e0d1ee-e75b-4cc0-8548-e4a48cf2eb18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:19.397530 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-16e0d1ee-e75b-4cc0-8548-e4a48cf2eb18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:19.405583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16e0d1ee-e75b-4cc0-8548-e4a48cf2eb18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:19.406659 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16e0d1ee-e75b-4cc0-8548-e4a48cf2eb18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:19.408280 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16e0d1ee-e75b-4cc0-8548-e4a48cf2eb18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:19.409095 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-16e0d1ee-e75b-4cc0-8548-e4a48cf2eb18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:19.551089 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-abd7c824-d508-44f2-b2e6-4f849d541f33 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:19.560003 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-abd7c824-d508-44f2-b2e6-4f849d541f33 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:19.561790 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-abd7c824-d508-44f2-b2e6-4f849d541f33 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:19.563985 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-abd7c824-d508-44f2-b2e6-4f849d541f33 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1738 microversion: 2.20 time: 0.191288 Jul 25 12:17:19.564627 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 199/404] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:19 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:19.574028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-16e0d1ee-e75b-4cc0-8548-e4a48cf2eb18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:19.586421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-16e0d1ee-e75b-4cc0-8548-e4a48cf2eb18 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.196035 Jul 25 12:17:19.587175 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 206/405] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:19 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:19.588619 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1288f9ba-f6aa-4e1b-84a5-9eeaf8732a1e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:19.589331 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1288f9ba-f6aa-4e1b-84a5-9eeaf8732a1e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:19.595485 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1288f9ba-f6aa-4e1b-84a5-9eeaf8732a1e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:19.596201 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1288f9ba-f6aa-4e1b-84a5-9eeaf8732a1e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:19.597103 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1288f9ba-f6aa-4e1b-84a5-9eeaf8732a1e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:19.597628 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1288f9ba-f6aa-4e1b-84a5-9eeaf8732a1e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:19.741597 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1288f9ba-f6aa-4e1b-84a5-9eeaf8732a1e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:19.749672 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1288f9ba-f6aa-4e1b-84a5-9eeaf8732a1e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1368 microversion: 2.1 time: 0.168509 Jul 25 12:17:19.763205 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 200/406] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:19 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:20.262168 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-06a7fb35-f032-486e-9f4a-b564aeb105ca tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:20.262788 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-06a7fb35-f032-486e-9f4a-b564aeb105ca tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:20.269970 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06a7fb35-f032-486e-9f4a-b564aeb105ca tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:20.270725 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06a7fb35-f032-486e-9f4a-b564aeb105ca tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:20.271525 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06a7fb35-f032-486e-9f4a-b564aeb105ca tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:20.271985 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-06a7fb35-f032-486e-9f4a-b564aeb105ca tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:20.426407 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-06a7fb35-f032-486e-9f4a-b564aeb105ca tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:20.435083 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-06a7fb35-f032-486e-9f4a-b564aeb105ca tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1371 microversion: 2.1 time: 0.176683 Jul 25 12:17:20.436310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 207/407] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:20 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:20.587263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a7988afb-71b9-4191-b33e-c91dbc96673c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:20.588139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a7988afb-71b9-4191-b33e-c91dbc96673c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:20.595307 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7988afb-71b9-4191-b33e-c91dbc96673c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:20.595986 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7988afb-71b9-4191-b33e-c91dbc96673c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:20.596901 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7988afb-71b9-4191-b33e-c91dbc96673c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:20.597494 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a7988afb-71b9-4191-b33e-c91dbc96673c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:20.611933 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cb4fd5f3-ecab-45db-ba64-679a133606cf tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:20.612532 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cb4fd5f3-ecab-45db-ba64-679a133606cf tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:20.626674 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb4fd5f3-ecab-45db-ba64-679a133606cf tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:20.627166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb4fd5f3-ecab-45db-ba64-679a133606cf tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:20.628051 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb4fd5f3-ecab-45db-ba64-679a133606cf tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:20.628508 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb4fd5f3-ecab-45db-ba64-679a133606cf tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:20.777675 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a7988afb-71b9-4191-b33e-c91dbc96673c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:20.779451 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cb4fd5f3-ecab-45db-ba64-679a133606cf tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:20.789774 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cb4fd5f3-ecab-45db-ba64-679a133606cf tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1722 microversion: 2.1 time: 0.181532 Jul 25 12:17:20.803636 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 208/408] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:20 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:20.803636 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d5eb8a94-cb50-4cdb-b5f7-a0867e0eb59d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:20.803636 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d5eb8a94-cb50-4cdb-b5f7-a0867e0eb59d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:20.803636 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d5eb8a94-cb50-4cdb-b5f7-a0867e0eb59d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:20.804091 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d5eb8a94-cb50-4cdb-b5f7-a0867e0eb59d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:20.804568 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d5eb8a94-cb50-4cdb-b5f7-a0867e0eb59d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:20.805419 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d5eb8a94-cb50-4cdb-b5f7-a0867e0eb59d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:20.805892 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a7988afb-71b9-4191-b33e-c91dbc96673c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:20.809163 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a7988afb-71b9-4191-b33e-c91dbc96673c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:20.810801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a7988afb-71b9-4191-b33e-c91dbc96673c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1738 microversion: 2.20 time: 0.227871 Jul 25 12:17:20.811578 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 201/409] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:20 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:20.962965 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d5eb8a94-cb50-4cdb-b5f7-a0867e0eb59d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:20.973472 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d5eb8a94-cb50-4cdb-b5f7-a0867e0eb59d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1368 microversion: 2.1 time: 0.181433 Jul 25 12:17:20.974097 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 209/410] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:20 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:21.460144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f27d7008-81a3-46c1-83eb-8ef765f343b4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:21.460745 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f27d7008-81a3-46c1-83eb-8ef765f343b4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:21.470871 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f27d7008-81a3-46c1-83eb-8ef765f343b4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:21.471349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f27d7008-81a3-46c1-83eb-8ef765f343b4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:21.472168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f27d7008-81a3-46c1-83eb-8ef765f343b4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:21.472597 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f27d7008-81a3-46c1-83eb-8ef765f343b4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:21.702317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f27d7008-81a3-46c1-83eb-8ef765f343b4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:21.710439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f27d7008-81a3-46c1-83eb-8ef765f343b4 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1371 microversion: 2.1 time: 0.254017 Jul 25 12:17:21.711571 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 202/411] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:21 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:21.811591 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aed7fe4e-d6df-4b85-9487-b75ab4a7948e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:21.812183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-aed7fe4e-d6df-4b85-9487-b75ab4a7948e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:21.818831 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aed7fe4e-d6df-4b85-9487-b75ab4a7948e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:21.819505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aed7fe4e-d6df-4b85-9487-b75ab4a7948e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:21.820441 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aed7fe4e-d6df-4b85-9487-b75ab4a7948e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:21.821019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aed7fe4e-d6df-4b85-9487-b75ab4a7948e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:21.834869 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cf31b157-3ba8-4f57-b637-1bd5a2f25c0c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:21.835769 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cf31b157-3ba8-4f57-b637-1bd5a2f25c0c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:21.850662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf31b157-3ba8-4f57-b637-1bd5a2f25c0c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:21.851409 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf31b157-3ba8-4f57-b637-1bd5a2f25c0c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:21.852237 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf31b157-3ba8-4f57-b637-1bd5a2f25c0c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:21.852743 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf31b157-3ba8-4f57-b637-1bd5a2f25c0c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:21.865691 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:21.899025 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=100 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:22.012701 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-aed7fe4e-d6df-4b85-9487-b75ab4a7948e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:22.020920 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-aed7fe4e-d6df-4b85-9487-b75ab4a7948e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1699 microversion: 2.1 time: 0.213414 Jul 25 12:17:22.021801 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 210/412] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:21 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1699 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:22.027103 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6b263eb6-00b6-4679-a7c9-0bcb1480080c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:22.028508 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6b263eb6-00b6-4679-a7c9-0bcb1480080c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:22.032436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=12 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:22.037725 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b263eb6-00b6-4679-a7c9-0bcb1480080c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:22.038175 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b263eb6-00b6-4679-a7c9-0bcb1480080c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:22.038941 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b263eb6-00b6-4679-a7c9-0bcb1480080c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:22.039366 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b263eb6-00b6-4679-a7c9-0bcb1480080c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:22.052587 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cf31b157-3ba8-4f57-b637-1bd5a2f25c0c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:22.061610 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cf31b157-3ba8-4f57-b637-1bd5a2f25c0c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:22.063195 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cf31b157-3ba8-4f57-b637-1bd5a2f25c0c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:22.064607 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cf31b157-3ba8-4f57-b637-1bd5a2f25c0c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1738 microversion: 2.20 time: 0.233610 Jul 25 12:17:22.065378 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 203/413] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:21 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:22.070183 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d1727a7e-3128-48f8-b0cf-288651198db2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:22.077128 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1727a7e-3128-48f8-b0cf-288651198db2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:22.077768 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d1727a7e-3128-48f8-b0cf-288651198db2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:22.102966 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d1727a7e-3128-48f8-b0cf-288651198db2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Going to try to start instance {{(pid=117776) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 12:17:22.176761 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d1727a7e-3128-48f8-b0cf-288651198db2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "POST /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/action" status: 202 len: 0 microversion: 2.1 time: 0.109940 Jul 25 12:17:22.180608 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 204/414] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:17:22 2022] POST /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:17:22.197566 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9fbcc387-a7fa-4258-bd4f-94d448d52fc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:22.197566 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9fbcc387-a7fa-4258-bd4f-94d448d52fc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:22.210186 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fbcc387-a7fa-4258-bd4f-94d448d52fc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:22.212979 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fbcc387-a7fa-4258-bd4f-94d448d52fc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:22.214616 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fbcc387-a7fa-4258-bd4f-94d448d52fc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:22.215142 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fbcc387-a7fa-4258-bd4f-94d448d52fc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:22.265610 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6b263eb6-00b6-4679-a7c9-0bcb1480080c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:22.266792 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6b263eb6-00b6-4679-a7c9-0bcb1480080c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1368 microversion: 2.1 time: 0.243750 Jul 25 12:17:22.279587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 211/415] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:22 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:22.279825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:22.484483 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=12 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:22.494385 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9fbcc387-a7fa-4258-bd4f-94d448d52fc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:22.508461 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9fbcc387-a7fa-4258-bd4f-94d448d52fc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1708 microversion: 2.1 time: 0.325892 Jul 25 12:17:22.509046 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 205/416] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:22 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1708 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:22.576027 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-87e59975-eb79-4871-bb66-98d29c8d7ff2 req-8c2995cc-df18-4b3d-9cb5-f38a6b4add59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0", "name": "network-vif-plugged", "status": "completed", "tag": "01fbcb44-8f5c-4f96-8ed4-469cbfa137f5"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:22.598335 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-87e59975-eb79-4871-bb66-98d29c8d7ff2 req-8c2995cc-df18-4b3d-9cb5-f38a6b4add59 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:22.598780 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-87e59975-eb79-4871-bb66-98d29c8d7ff2 req-8c2995cc-df18-4b3d-9cb5-f38a6b4add59 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:22.624914 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-87e59975-eb79-4871-bb66-98d29c8d7ff2 req-8c2995cc-df18-4b3d-9cb5-f38a6b4add59 service nova] Creating event network-vif-plugged:01fbcb44-8f5c-4f96-8ed4-469cbfa137f5 for instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 on hv-cinder-79760 Jul 25 12:17:22.638977 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-87e59975-eb79-4871-bb66-98d29c8d7ff2 req-8c2995cc-df18-4b3d-9cb5-f38a6b4add59 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066572 Jul 25 12:17:22.639892 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 212/417] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:17:22.734290 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8e5cba1c-67a4-4165-9e7d-932e89a9998f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:22.736145 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8e5cba1c-67a4-4165-9e7d-932e89a9998f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:22.745744 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e5cba1c-67a4-4165-9e7d-932e89a9998f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:22.748955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e5cba1c-67a4-4165-9e7d-932e89a9998f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:22.750479 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e5cba1c-67a4-4165-9e7d-932e89a9998f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:22.754096 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e5cba1c-67a4-4165-9e7d-932e89a9998f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:23.089490 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d1fb86fb-7fdb-42a0-a4f6-efdbb9c81cfc tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:23.090118 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d1fb86fb-7fdb-42a0-a4f6-efdbb9c81cfc tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:23.100701 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1fb86fb-7fdb-42a0-a4f6-efdbb9c81cfc tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:23.101184 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1fb86fb-7fdb-42a0-a4f6-efdbb9c81cfc tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:23.112398 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1fb86fb-7fdb-42a0-a4f6-efdbb9c81cfc tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:23.113128 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1fb86fb-7fdb-42a0-a4f6-efdbb9c81cfc tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:23.176815 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8e5cba1c-67a4-4165-9e7d-932e89a9998f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:23.184687 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8e5cba1c-67a4-4165-9e7d-932e89a9998f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1371 microversion: 2.1 time: 0.454730 Jul 25 12:17:23.191966 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 206/418] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:22 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1371 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:23.292039 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a8020375-bbd5-48c6-a10b-fd8274081456 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:23.293122 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a8020375-bbd5-48c6-a10b-fd8274081456 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:23.302525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8020375-bbd5-48c6-a10b-fd8274081456 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:23.302978 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8020375-bbd5-48c6-a10b-fd8274081456 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:23.303950 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8020375-bbd5-48c6-a10b-fd8274081456 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:23.304384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8020375-bbd5-48c6-a10b-fd8274081456 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:23.326634 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d1fb86fb-7fdb-42a0-a4f6-efdbb9c81cfc tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:23.338727 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d1fb86fb-7fdb-42a0-a4f6-efdbb9c81cfc tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:23.340734 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d1fb86fb-7fdb-42a0-a4f6-efdbb9c81cfc tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:23.342348 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d1fb86fb-7fdb-42a0-a4f6-efdbb9c81cfc tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1738 microversion: 2.20 time: 0.257771 Jul 25 12:17:23.343368 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 213/419] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:23 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:23.451216 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a8020375-bbd5-48c6-a10b-fd8274081456 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:23.459073 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a8020375-bbd5-48c6-a10b-fd8274081456 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1368 microversion: 2.1 time: 0.170837 Jul 25 12:17:23.459675 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 207/420] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:23 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:23.534960 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-797e0f08-6e9f-4348-b793-263eec6802ec tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:23.535601 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-797e0f08-6e9f-4348-b793-263eec6802ec tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:23.541534 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-797e0f08-6e9f-4348-b793-263eec6802ec tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:23.541980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-797e0f08-6e9f-4348-b793-263eec6802ec tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:23.542733 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-797e0f08-6e9f-4348-b793-263eec6802ec tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:23.543198 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-797e0f08-6e9f-4348-b793-263eec6802ec tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:23.547785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:23.673822 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-797e0f08-6e9f-4348-b793-263eec6802ec tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:23.681931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-797e0f08-6e9f-4348-b793-263eec6802ec tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1708 microversion: 2.1 time: 0.151633 Jul 25 12:17:23.682756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 214/421] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:23 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:24.212389 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-12443148-7e7b-4c48-885d-ac7c1106b03f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:24.213095 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-12443148-7e7b-4c48-885d-ac7c1106b03f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:24.220323 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12443148-7e7b-4c48-885d-ac7c1106b03f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:24.220863 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12443148-7e7b-4c48-885d-ac7c1106b03f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:24.221687 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12443148-7e7b-4c48-885d-ac7c1106b03f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:24.222190 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12443148-7e7b-4c48-885d-ac7c1106b03f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:24.365624 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b8553830-9cea-4753-bb6c-8f8a96c47c2d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:24.366798 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b8553830-9cea-4753-bb6c-8f8a96c47c2d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:24.369210 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:24.369877 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-12443148-7e7b-4c48-885d-ac7c1106b03f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:24.374526 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8553830-9cea-4753-bb6c-8f8a96c47c2d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:24.375464 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8553830-9cea-4753-bb6c-8f8a96c47c2d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:24.376434 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8553830-9cea-4753-bb6c-8f8a96c47c2d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:24.377042 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b8553830-9cea-4753-bb6c-8f8a96c47c2d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:24.378989 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-12443148-7e7b-4c48-885d-ac7c1106b03f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1371 microversion: 2.1 time: 0.170460 Jul 25 12:17:24.380212 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 208/422] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:24 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:24.480205 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ec0b7978-c929-41be-8db3-ca908e98597c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:24.480805 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ec0b7978-c929-41be-8db3-ca908e98597c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:24.486729 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ec0b7978-c929-41be-8db3-ca908e98597c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:24.487167 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ec0b7978-c929-41be-8db3-ca908e98597c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:24.487949 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ec0b7978-c929-41be-8db3-ca908e98597c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:24.488377 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ec0b7978-c929-41be-8db3-ca908e98597c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:24.511205 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b8553830-9cea-4753-bb6c-8f8a96c47c2d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:24.519868 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b8553830-9cea-4753-bb6c-8f8a96c47c2d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:24.521379 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b8553830-9cea-4753-bb6c-8f8a96c47c2d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:24.522591 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b8553830-9cea-4753-bb6c-8f8a96c47c2d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1720 microversion: 2.20 time: 0.160892 Jul 25 12:17:24.523131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 215/423] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:24 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:24.615831 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ec0b7978-c929-41be-8db3-ca908e98597c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:24.623139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ec0b7978-c929-41be-8db3-ca908e98597c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1368 microversion: 2.1 time: 0.146697 Jul 25 12:17:24.623720 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 209/424] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:24 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:24.655431 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-20d7b376-6ec3-4b7a-ba37-8393fc2f90ed req-90085856-1b89-407f-b5af-a3878cd25fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484cf6bc-2993-476c-ab86-45ac7e109720", "name": "network-vif-plugged", "status": "completed", "tag": "9251fe67-d381-42a4-95a5-12fffca6f2be"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:24.665038 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-20d7b376-6ec3-4b7a-ba37-8393fc2f90ed req-90085856-1b89-407f-b5af-a3878cd25fa8 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:24.665480 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-20d7b376-6ec3-4b7a-ba37-8393fc2f90ed req-90085856-1b89-407f-b5af-a3878cd25fa8 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:24.676551 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-20d7b376-6ec3-4b7a-ba37-8393fc2f90ed req-90085856-1b89-407f-b5af-a3878cd25fa8 service nova] Creating event network-vif-plugged:9251fe67-d381-42a4-95a5-12fffca6f2be for instance 484cf6bc-2993-476c-ab86-45ac7e109720 on hv-cinder-79760 Jul 25 12:17:24.681232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-20d7b376-6ec3-4b7a-ba37-8393fc2f90ed req-90085856-1b89-407f-b5af-a3878cd25fa8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029435 Jul 25 12:17:24.681814 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 216/425] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:17:24.702147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e848111e-b34d-4df5-95ca-c9b2adc17e93 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:24.702760 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e848111e-b34d-4df5-95ca-c9b2adc17e93 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:24.708889 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e848111e-b34d-4df5-95ca-c9b2adc17e93 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:24.709285 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e848111e-b34d-4df5-95ca-c9b2adc17e93 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:24.710043 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e848111e-b34d-4df5-95ca-c9b2adc17e93 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:24.710475 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e848111e-b34d-4df5-95ca-c9b2adc17e93 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:24.838038 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e848111e-b34d-4df5-95ca-c9b2adc17e93 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:24.845888 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e848111e-b34d-4df5-95ca-c9b2adc17e93 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1708 microversion: 2.1 time: 0.147603 Jul 25 12:17:24.846828 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 210/426] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:24 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1708 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:25.402058 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-edc06e48-56c3-4ad2-98c0-f55f06bedbc7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:25.402784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-edc06e48-56c3-4ad2-98c0-f55f06bedbc7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:25.409953 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edc06e48-56c3-4ad2-98c0-f55f06bedbc7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:25.410399 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edc06e48-56c3-4ad2-98c0-f55f06bedbc7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:25.411161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edc06e48-56c3-4ad2-98c0-f55f06bedbc7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:25.411622 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edc06e48-56c3-4ad2-98c0-f55f06bedbc7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:25.547692 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0cf6d1c3-505e-48b9-8930-5afd254c4000 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:25.548312 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0cf6d1c3-505e-48b9-8930-5afd254c4000 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:25.556415 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0cf6d1c3-505e-48b9-8930-5afd254c4000 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:25.556865 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0cf6d1c3-505e-48b9-8930-5afd254c4000 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:25.557642 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0cf6d1c3-505e-48b9-8930-5afd254c4000 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:25.558077 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0cf6d1c3-505e-48b9-8930-5afd254c4000 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:25.710696 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0cf6d1c3-505e-48b9-8930-5afd254c4000 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:25.739147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0cf6d1c3-505e-48b9-8930-5afd254c4000 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:25.741842 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0cf6d1c3-505e-48b9-8930-5afd254c4000 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:25.744657 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0cf6d1c3-505e-48b9-8930-5afd254c4000 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1720 microversion: 2.20 time: 0.200932 Jul 25 12:17:25.773969 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 211/427] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:25 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1720 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:25.774351 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-edc06e48-56c3-4ad2-98c0-f55f06bedbc7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:25.774471 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f07e6867-b1fd-4db9-a300-5ba54149337b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:25.774471 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f07e6867-b1fd-4db9-a300-5ba54149337b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:25.777772 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-edc06e48-56c3-4ad2-98c0-f55f06bedbc7 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1371 microversion: 2.1 time: 0.380327 Jul 25 12:17:25.787601 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f07e6867-b1fd-4db9-a300-5ba54149337b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:25.787601 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f07e6867-b1fd-4db9-a300-5ba54149337b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:25.787601 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f07e6867-b1fd-4db9-a300-5ba54149337b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:25.787601 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f07e6867-b1fd-4db9-a300-5ba54149337b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:25.788757 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 217/428] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:25 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:25.868075 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-220ef62c-dfdc-47c3-a35e-fa519acc46e5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:25.868760 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-220ef62c-dfdc-47c3-a35e-fa519acc46e5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:25.874785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-220ef62c-dfdc-47c3-a35e-fa519acc46e5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:25.875224 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-220ef62c-dfdc-47c3-a35e-fa519acc46e5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:25.876027 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-220ef62c-dfdc-47c3-a35e-fa519acc46e5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:25.876454 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-220ef62c-dfdc-47c3-a35e-fa519acc46e5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:25.917137 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f07e6867-b1fd-4db9-a300-5ba54149337b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:25.925288 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f07e6867-b1fd-4db9-a300-5ba54149337b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1368 microversion: 2.1 time: 0.155227 Jul 25 12:17:25.925860 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 212/429] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:25 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:26.002071 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-220ef62c-dfdc-47c3-a35e-fa519acc46e5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:26.009805 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-220ef62c-dfdc-47c3-a35e-fa519acc46e5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1712 microversion: 2.1 time: 0.145640 Jul 25 12:17:26.010360 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 218/430] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:25 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1712 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:26.774266 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7cdd8dfe-0866-4985-a264-0dd478cfbf86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:26.774876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7cdd8dfe-0866-4985-a264-0dd478cfbf86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:26.781732 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cdd8dfe-0866-4985-a264-0dd478cfbf86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:26.782425 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cdd8dfe-0866-4985-a264-0dd478cfbf86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:26.783217 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cdd8dfe-0866-4985-a264-0dd478cfbf86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:26.783667 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cdd8dfe-0866-4985-a264-0dd478cfbf86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:26.798645 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-98dc0339-79db-4cb6-8fd8-8e12d34a0683 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:26.799341 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-98dc0339-79db-4cb6-8fd8-8e12d34a0683 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:26.805719 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98dc0339-79db-4cb6-8fd8-8e12d34a0683 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:26.806411 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98dc0339-79db-4cb6-8fd8-8e12d34a0683 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:26.807186 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98dc0339-79db-4cb6-8fd8-8e12d34a0683 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:26.807712 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-98dc0339-79db-4cb6-8fd8-8e12d34a0683 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:26.943207 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-98dc0339-79db-4cb6-8fd8-8e12d34a0683 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:26.950807 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-98dc0339-79db-4cb6-8fd8-8e12d34a0683 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1565 microversion: 2.1 time: 0.156532 Jul 25 12:17:26.951380 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 219/431] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:26 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:26.955840 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-74b9df1a-b716-4df3-aa85-307b6fc36cf0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:26.956709 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-74b9df1a-b716-4df3-aa85-307b6fc36cf0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:26.962806 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74b9df1a-b716-4df3-aa85-307b6fc36cf0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:26.963356 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74b9df1a-b716-4df3-aa85-307b6fc36cf0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:26.964374 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74b9df1a-b716-4df3-aa85-307b6fc36cf0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:26.964871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-74b9df1a-b716-4df3-aa85-307b6fc36cf0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:26.987978 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7cdd8dfe-0866-4985-a264-0dd478cfbf86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:26.996340 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7cdd8dfe-0866-4985-a264-0dd478cfbf86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:26.997958 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7cdd8dfe-0866-4985-a264-0dd478cfbf86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:26.999310 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7cdd8dfe-0866-4985-a264-0dd478cfbf86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1720 microversion: 2.20 time: 0.228877 Jul 25 12:17:27.000525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 213/432] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:26 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:27.005446 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e892bbb0-d070-4c85-b147-d8eb6180a8eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:27.006000 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e892bbb0-d070-4c85-b147-d8eb6180a8eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:27.012342 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e892bbb0-d070-4c85-b147-d8eb6180a8eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:27.012857 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e892bbb0-d070-4c85-b147-d8eb6180a8eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:27.013725 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e892bbb0-d070-4c85-b147-d8eb6180a8eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:27.014216 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e892bbb0-d070-4c85-b147-d8eb6180a8eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:27.099492 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-74b9df1a-b716-4df3-aa85-307b6fc36cf0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:27.107053 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-74b9df1a-b716-4df3-aa85-307b6fc36cf0 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1368 microversion: 2.1 time: 0.154702 Jul 25 12:17:27.107637 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 220/433] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:26 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:27.113541 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e892bbb0-d070-4c85-b147-d8eb6180a8eb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111903 Jul 25 12:17:27.114139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 214/434] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Jul 25 12:17:27 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:17:28.001223 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-e391c2d4-d7f4-4db9-b36e-73162d19f2be req-6c90cd14-99ec-48e1-b7d1-9c5e1aed59df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0", "tag": "01fbcb44-8f5c-4f96-8ed4-469cbfa137f5"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:28.011340 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-e391c2d4-d7f4-4db9-b36e-73162d19f2be req-6c90cd14-99ec-48e1-b7d1-9c5e1aed59df service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:28.011805 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-e391c2d4-d7f4-4db9-b36e-73162d19f2be req-6c90cd14-99ec-48e1-b7d1-9c5e1aed59df service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:28.023903 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-273ac422-9f35-4b9c-8e84-ee6fdd86b39f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:28.024544 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-273ac422-9f35-4b9c-8e84-ee6fdd86b39f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:28.026709 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-e391c2d4-d7f4-4db9-b36e-73162d19f2be req-6c90cd14-99ec-48e1-b7d1-9c5e1aed59df service nova] Creating event network-changed:01fbcb44-8f5c-4f96-8ed4-469cbfa137f5 for instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 on hv-cinder-79760 Jul 25 12:17:28.031289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-273ac422-9f35-4b9c-8e84-ee6fdd86b39f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:28.031779 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-273ac422-9f35-4b9c-8e84-ee6fdd86b39f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:28.032409 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-e391c2d4-d7f4-4db9-b36e-73162d19f2be req-6c90cd14-99ec-48e1-b7d1-9c5e1aed59df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035142 Jul 25 12:17:28.033004 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 221/435] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:17:28.033161 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-273ac422-9f35-4b9c-8e84-ee6fdd86b39f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:28.033813 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-273ac422-9f35-4b9c-8e84-ee6fdd86b39f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:28.130676 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1ef8abf3-96af-4ab8-a781-fb60a141c3a8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:28.131362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1ef8abf3-96af-4ab8-a781-fb60a141c3a8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:28.137959 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ef8abf3-96af-4ab8-a781-fb60a141c3a8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:28.138634 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ef8abf3-96af-4ab8-a781-fb60a141c3a8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:28.139635 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ef8abf3-96af-4ab8-a781-fb60a141c3a8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:28.140870 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ef8abf3-96af-4ab8-a781-fb60a141c3a8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:28.166781 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-273ac422-9f35-4b9c-8e84-ee6fdd86b39f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:28.176125 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-273ac422-9f35-4b9c-8e84-ee6fdd86b39f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:28.177890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-273ac422-9f35-4b9c-8e84-ee6fdd86b39f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:28.185416 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-273ac422-9f35-4b9c-8e84-ee6fdd86b39f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1720 microversion: 2.20 time: 0.166069 Jul 25 12:17:28.200620 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 215/436] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:28 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:28.282604 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1ef8abf3-96af-4ab8-a781-fb60a141c3a8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:28.290146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1ef8abf3-96af-4ab8-a781-fb60a141c3a8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1368 microversion: 2.1 time: 0.163651 Jul 25 12:17:28.290713 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 222/437] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:28 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:28.379335 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-b687cf67-8ccc-4d9d-8a55-6ce1e23871b9 req-c3cb3751-3d82-47ad-aa40-e6ddb2207e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66654721-31e2-48d8-a0ea-c146d277ab47", "name": "network-vif-unplugged", "status": "completed", "tag": "d01f3ff0-df08-4605-a057-7920ee080060"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:28.388619 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b687cf67-8ccc-4d9d-8a55-6ce1e23871b9 req-c3cb3751-3d82-47ad-aa40-e6ddb2207e63 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:28.389062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b687cf67-8ccc-4d9d-8a55-6ce1e23871b9 req-c3cb3751-3d82-47ad-aa40-e6ddb2207e63 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:28.400872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-b687cf67-8ccc-4d9d-8a55-6ce1e23871b9 req-c3cb3751-3d82-47ad-aa40-e6ddb2207e63 service nova] Creating event network-vif-unplugged:d01f3ff0-df08-4605-a057-7920ee080060 for instance 66654721-31e2-48d8-a0ea-c146d277ab47 on hv-cinder-79760 Jul 25 12:17:28.406392 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-b687cf67-8ccc-4d9d-8a55-6ce1e23871b9 req-c3cb3751-3d82-47ad-aa40-e6ddb2207e63 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030271 Jul 25 12:17:28.407260 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 216/438] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:17:29.225931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-604ebc5c-954d-4fcf-8e6a-150f588d1a45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:29.226568 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-604ebc5c-954d-4fcf-8e6a-150f588d1a45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:29.233207 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-604ebc5c-954d-4fcf-8e6a-150f588d1a45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:29.233655 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-604ebc5c-954d-4fcf-8e6a-150f588d1a45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:29.234910 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-604ebc5c-954d-4fcf-8e6a-150f588d1a45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:29.235346 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-604ebc5c-954d-4fcf-8e6a-150f588d1a45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:29.311411 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1cee2696-829b-41be-b2df-b8123e8a86f7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:29.311933 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1cee2696-829b-41be-b2df-b8123e8a86f7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:29.318883 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1cee2696-829b-41be-b2df-b8123e8a86f7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:29.319335 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1cee2696-829b-41be-b2df-b8123e8a86f7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:29.320136 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1cee2696-829b-41be-b2df-b8123e8a86f7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:29.320579 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1cee2696-829b-41be-b2df-b8123e8a86f7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:29.362713 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-604ebc5c-954d-4fcf-8e6a-150f588d1a45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:29.370652 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-604ebc5c-954d-4fcf-8e6a-150f588d1a45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:29.372176 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-604ebc5c-954d-4fcf-8e6a-150f588d1a45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:29.373353 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-604ebc5c-954d-4fcf-8e6a-150f588d1a45 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1720 microversion: 2.20 time: 0.151923 Jul 25 12:17:29.373905 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 223/439] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:29 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:29.673860 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1cee2696-829b-41be-b2df-b8123e8a86f7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:29.681819 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1cee2696-829b-41be-b2df-b8123e8a86f7 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1368 microversion: 2.1 time: 0.375179 Jul 25 12:17:29.682419 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 217/440] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:29 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1368 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:30.397617 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5f65da5d-f765-4b09-a373-7439134a7a29 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:30.398220 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5f65da5d-f765-4b09-a373-7439134a7a29 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:30.404665 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f65da5d-f765-4b09-a373-7439134a7a29 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:30.405108 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f65da5d-f765-4b09-a373-7439134a7a29 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:30.405862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f65da5d-f765-4b09-a373-7439134a7a29 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:30.406300 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5f65da5d-f765-4b09-a373-7439134a7a29 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:30.532412 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5f65da5d-f765-4b09-a373-7439134a7a29 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:30.540221 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5f65da5d-f765-4b09-a373-7439134a7a29 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:30.541715 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5f65da5d-f765-4b09-a373-7439134a7a29 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:30.543832 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5f65da5d-f765-4b09-a373-7439134a7a29 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1723 microversion: 2.20 time: 0.149859 Jul 25 12:17:30.544393 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 224/441] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:30 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:30.567156 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fe2c70ee-4fd3-46c8-986e-48fc2b484a12 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f17d095-3065-46cd-be41-90ce82ddc011"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:30.569450 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fe2c70ee-4fd3-46c8-986e-48fc2b484a12 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:30.576220 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe2c70ee-4fd3-46c8-986e-48fc2b484a12 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:30.576436 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe2c70ee-4fd3-46c8-986e-48fc2b484a12 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:30.577216 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe2c70ee-4fd3-46c8-986e-48fc2b484a12 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:30.577654 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fe2c70ee-4fd3-46c8-986e-48fc2b484a12 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:30.702077 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1cfe26ac-91a9-4a28-97aa-841d5697cbb2 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:30.703043 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1cfe26ac-91a9-4a28-97aa-841d5697cbb2 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:30.709527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1cfe26ac-91a9-4a28-97aa-841d5697cbb2 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:30.709998 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1cfe26ac-91a9-4a28-97aa-841d5697cbb2 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:30.710769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1cfe26ac-91a9-4a28-97aa-841d5697cbb2 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:30.711204 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1cfe26ac-91a9-4a28-97aa-841d5697cbb2 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:30.800330 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:30.862234 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1cfe26ac-91a9-4a28-97aa-841d5697cbb2 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:30.872944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1cfe26ac-91a9-4a28-97aa-841d5697cbb2 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1558 microversion: 2.1 time: 0.174586 Jul 25 12:17:30.873910 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 225/442] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:30 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:30.899328 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e1b74d1e-4a0d-4480-aa99-8ea9ec4a8bdf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:30.900776 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e1b74d1e-4a0d-4480-aa99-8ea9ec4a8bdf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:30.908664 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e1b74d1e-4a0d-4480-aa99-8ea9ec4a8bdf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:30.909212 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e1b74d1e-4a0d-4480-aa99-8ea9ec4a8bdf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:30.909998 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e1b74d1e-4a0d-4480-aa99-8ea9ec4a8bdf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:30.910441 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e1b74d1e-4a0d-4480-aa99-8ea9ec4a8bdf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:30.910560 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fe2c70ee-4fd3-46c8-986e-48fc2b484a12 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "POST /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.347439 Jul 25 12:17:30.911261 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 218/443] 10.222.0.42 () {62 vars in 1364 bytes} [Mon Jul 25 12:17:30 2022] POST /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-volume_attachments => generated 188 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:17:30.992043 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e1b74d1e-4a0d-4480-aa99-8ea9ec4a8bdf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096644 Jul 25 12:17:30.992633 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 226/444] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Jul 25 12:17:30 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:17:31.040832 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3e0b84d3-2eaf-4253-9fd0-a76523845fa0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:31.041388 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3e0b84d3-2eaf-4253-9fd0-a76523845fa0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:31.048653 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e0b84d3-2eaf-4253-9fd0-a76523845fa0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:31.049319 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e0b84d3-2eaf-4253-9fd0-a76523845fa0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:31.050096 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e0b84d3-2eaf-4253-9fd0-a76523845fa0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:31.050532 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e0b84d3-2eaf-4253-9fd0-a76523845fa0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:31.141127 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3e0b84d3-2eaf-4253-9fd0-a76523845fa0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "POST /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/action" status: 202 len: 0 microversion: 2.20 time: 0.103935 Jul 25 12:17:31.142210 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 219/445] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Jul 25 12:17:31 2022] POST /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:17:31.151664 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-942dfaa5-955f-4304-b2ca-7864ef598ba3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:31.153168 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-942dfaa5-955f-4304-b2ca-7864ef598ba3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:31.173957 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-942dfaa5-955f-4304-b2ca-7864ef598ba3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:31.174668 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-942dfaa5-955f-4304-b2ca-7864ef598ba3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:31.175638 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-942dfaa5-955f-4304-b2ca-7864ef598ba3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:31.176216 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-942dfaa5-955f-4304-b2ca-7864ef598ba3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:31.452611 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-942dfaa5-955f-4304-b2ca-7864ef598ba3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:31.461380 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-942dfaa5-955f-4304-b2ca-7864ef598ba3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:31.462878 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-942dfaa5-955f-4304-b2ca-7864ef598ba3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:31.464060 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-942dfaa5-955f-4304-b2ca-7864ef598ba3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1749 microversion: 2.20 time: 0.318065 Jul 25 12:17:31.464764 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 227/446] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:31 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1749 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:32.012970 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-fc280810-931d-4815-a2a4-e0062a57620b req-17c48a36-e625-4ee9-a496-8a0d90244b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484cf6bc-2993-476c-ab86-45ac7e109720", "tag": "9251fe67-d381-42a4-95a5-12fffca6f2be"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:32.023891 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-fc280810-931d-4815-a2a4-e0062a57620b req-17c48a36-e625-4ee9-a496-8a0d90244b69 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:32.024334 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-fc280810-931d-4815-a2a4-e0062a57620b req-17c48a36-e625-4ee9-a496-8a0d90244b69 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:32.027126 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-73582f0b-af32-48ab-b881-26c4b5fddf5f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:32.033481 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-73582f0b-af32-48ab-b881-26c4b5fddf5f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:32.036375 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-fc280810-931d-4815-a2a4-e0062a57620b req-17c48a36-e625-4ee9-a496-8a0d90244b69 service nova] Creating event network-changed:9251fe67-d381-42a4-95a5-12fffca6f2be for instance 484cf6bc-2993-476c-ab86-45ac7e109720 on hv-cinder-79760 Jul 25 12:17:32.041779 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-fc280810-931d-4815-a2a4-e0062a57620b req-17c48a36-e625-4ee9-a496-8a0d90244b69 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032313 Jul 25 12:17:32.042586 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 220/447] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:17:32.052686 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73582f0b-af32-48ab-b881-26c4b5fddf5f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:32.053654 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73582f0b-af32-48ab-b881-26c4b5fddf5f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:32.054825 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73582f0b-af32-48ab-b881-26c4b5fddf5f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:32.055414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-73582f0b-af32-48ab-b881-26c4b5fddf5f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:32.144811 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-73582f0b-af32-48ab-b881-26c4b5fddf5f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "POST /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/action" status: 202 len: 0 microversion: 2.1 time: 0.125368 Jul 25 12:17:32.145983 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 228/448] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:17:32 2022] POST /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:17:32.160855 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6e4bf9df-b6d6-454f-b89f-89e1109665df tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:32.161852 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6e4bf9df-b6d6-454f-b89f-89e1109665df tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:32.179788 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6e4bf9df-b6d6-454f-b89f-89e1109665df tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:32.180675 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6e4bf9df-b6d6-454f-b89f-89e1109665df tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:32.188497 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6e4bf9df-b6d6-454f-b89f-89e1109665df tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:32.189927 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6e4bf9df-b6d6-454f-b89f-89e1109665df tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:32.488709 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c5066aa5-eb5c-4d65-b7f2-44f22c38b5e5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:32.490132 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c5066aa5-eb5c-4d65-b7f2-44f22c38b5e5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:32.497349 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5066aa5-eb5c-4d65-b7f2-44f22c38b5e5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:32.497791 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5066aa5-eb5c-4d65-b7f2-44f22c38b5e5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:32.498742 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5066aa5-eb5c-4d65-b7f2-44f22c38b5e5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:32.499329 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c5066aa5-eb5c-4d65-b7f2-44f22c38b5e5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:32.512391 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6e4bf9df-b6d6-454f-b89f-89e1109665df tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:32.523409 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6e4bf9df-b6d6-454f-b89f-89e1109665df tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1751 microversion: 2.1 time: 0.373063 Jul 25 12:17:32.525768 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 221/449] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:32 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1751 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:32.651972 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c5066aa5-eb5c-4d65-b7f2-44f22c38b5e5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:32.661576 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c5066aa5-eb5c-4d65-b7f2-44f22c38b5e5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:32.663413 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c5066aa5-eb5c-4d65-b7f2-44f22c38b5e5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:32.664854 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c5066aa5-eb5c-4d65-b7f2-44f22c38b5e5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1751 microversion: 2.20 time: 0.181001 Jul 25 12:17:32.677432 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 229/450] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:32 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:33.548462 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a8d78d8c-25d6-46bb-ae7e-ebcca9d93d46 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:33.549075 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a8d78d8c-25d6-46bb-ae7e-ebcca9d93d46 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:33.555723 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8d78d8c-25d6-46bb-ae7e-ebcca9d93d46 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:33.556171 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8d78d8c-25d6-46bb-ae7e-ebcca9d93d46 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:33.556931 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8d78d8c-25d6-46bb-ae7e-ebcca9d93d46 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:33.557364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a8d78d8c-25d6-46bb-ae7e-ebcca9d93d46 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:33.690121 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-56396282-6723-477b-b3e6-e43355128711 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:33.690821 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-56396282-6723-477b-b3e6-e43355128711 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:33.697122 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-56396282-6723-477b-b3e6-e43355128711 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:33.697572 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-56396282-6723-477b-b3e6-e43355128711 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:33.698364 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-56396282-6723-477b-b3e6-e43355128711 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:33.698796 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-56396282-6723-477b-b3e6-e43355128711 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:33.702523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a8d78d8c-25d6-46bb-ae7e-ebcca9d93d46 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:33.710548 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a8d78d8c-25d6-46bb-ae7e-ebcca9d93d46 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.166576 Jul 25 12:17:33.711109 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 222/451] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:33 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:33.829950 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-56396282-6723-477b-b3e6-e43355128711 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:33.838183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-56396282-6723-477b-b3e6-e43355128711 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:33.839690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-56396282-6723-477b-b3e6-e43355128711 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:33.840843 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-56396282-6723-477b-b3e6-e43355128711 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.155288 Jul 25 12:17:33.841400 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 230/452] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:33 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:34.732744 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-68deea58-af5b-4497-bccc-630db57bdc2f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:34.734057 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-68deea58-af5b-4497-bccc-630db57bdc2f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:34.751781 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68deea58-af5b-4497-bccc-630db57bdc2f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:34.752225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68deea58-af5b-4497-bccc-630db57bdc2f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:34.752990 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68deea58-af5b-4497-bccc-630db57bdc2f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:34.753492 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-68deea58-af5b-4497-bccc-630db57bdc2f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:34.865235 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4fcad2fb-c06e-4cf6-a375-d921ef309d2e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:34.865850 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4fcad2fb-c06e-4cf6-a375-d921ef309d2e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:34.883332 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fcad2fb-c06e-4cf6-a375-d921ef309d2e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:34.883817 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fcad2fb-c06e-4cf6-a375-d921ef309d2e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:34.890068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fcad2fb-c06e-4cf6-a375-d921ef309d2e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:34.890516 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4fcad2fb-c06e-4cf6-a375-d921ef309d2e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:34.932863 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-68deea58-af5b-4497-bccc-630db57bdc2f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:34.940734 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:34.942477 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-68deea58-af5b-4497-bccc-630db57bdc2f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.213787 Jul 25 12:17:34.959716 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 223/453] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:34 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:35.062613 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4fcad2fb-c06e-4cf6-a375-d921ef309d2e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:35.071175 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4fcad2fb-c06e-4cf6-a375-d921ef309d2e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:35.073048 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4fcad2fb-c06e-4cf6-a375-d921ef309d2e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:35.074220 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4fcad2fb-c06e-4cf6-a375-d921ef309d2e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.213359 Jul 25 12:17:35.074783 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 231/454] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:34 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:35.964790 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e66f5fc3-f2a3-4627-892e-08f37e5eb994 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:35.965393 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e66f5fc3-f2a3-4627-892e-08f37e5eb994 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:35.972569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e66f5fc3-f2a3-4627-892e-08f37e5eb994 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:35.973013 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e66f5fc3-f2a3-4627-892e-08f37e5eb994 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:35.973770 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e66f5fc3-f2a3-4627-892e-08f37e5eb994 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:35.974220 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e66f5fc3-f2a3-4627-892e-08f37e5eb994 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:36.099088 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0b9b1594-9321-4e97-ba38-45b16cd19abb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:36.099715 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0b9b1594-9321-4e97-ba38-45b16cd19abb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:36.106114 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b9b1594-9321-4e97-ba38-45b16cd19abb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:36.107004 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b9b1594-9321-4e97-ba38-45b16cd19abb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:36.108101 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b9b1594-9321-4e97-ba38-45b16cd19abb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:36.108858 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b9b1594-9321-4e97-ba38-45b16cd19abb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:36.124028 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e66f5fc3-f2a3-4627-892e-08f37e5eb994 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:36.132087 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e66f5fc3-f2a3-4627-892e-08f37e5eb994 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.171087 Jul 25 12:17:36.132653 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 224/455] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:35 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:36.258870 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0b9b1594-9321-4e97-ba38-45b16cd19abb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:36.272984 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0b9b1594-9321-4e97-ba38-45b16cd19abb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:36.275173 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0b9b1594-9321-4e97-ba38-45b16cd19abb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:36.276374 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0b9b1594-9321-4e97-ba38-45b16cd19abb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.181366 Jul 25 12:17:36.277038 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 232/456] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:36 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:37.154269 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8b045e89-6f77-4888-a041-6658951a7998 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:37.154876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8b045e89-6f77-4888-a041-6658951a7998 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:37.162245 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8b045e89-6f77-4888-a041-6658951a7998 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:37.162693 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8b045e89-6f77-4888-a041-6658951a7998 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:37.163459 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8b045e89-6f77-4888-a041-6658951a7998 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:37.163922 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8b045e89-6f77-4888-a041-6658951a7998 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:37.305512 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d17eb138-fd36-4512-9c11-622d060f7ab6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:37.306120 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d17eb138-fd36-4512-9c11-622d060f7ab6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:37.311088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8b045e89-6f77-4888-a041-6658951a7998 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:37.315238 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d17eb138-fd36-4512-9c11-622d060f7ab6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:37.315997 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d17eb138-fd36-4512-9c11-622d060f7ab6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:37.317418 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d17eb138-fd36-4512-9c11-622d060f7ab6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:37.317919 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d17eb138-fd36-4512-9c11-622d060f7ab6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:37.319472 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8b045e89-6f77-4888-a041-6658951a7998 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.169508 Jul 25 12:17:37.320239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 225/457] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:37 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:37.465597 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d17eb138-fd36-4512-9c11-622d060f7ab6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:37.476002 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d17eb138-fd36-4512-9c11-622d060f7ab6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:37.477501 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d17eb138-fd36-4512-9c11-622d060f7ab6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:37.478680 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d17eb138-fd36-4512-9c11-622d060f7ab6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.181716 Jul 25 12:17:37.479243 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 233/458] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:37 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:38.342130 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5f6bae85-26f0-4503-8cc5-8c6489b975e5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:38.342744 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5f6bae85-26f0-4503-8cc5-8c6489b975e5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:38.349245 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f6bae85-26f0-4503-8cc5-8c6489b975e5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:38.349686 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f6bae85-26f0-4503-8cc5-8c6489b975e5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:38.350445 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f6bae85-26f0-4503-8cc5-8c6489b975e5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:38.350871 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f6bae85-26f0-4503-8cc5-8c6489b975e5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:38.501278 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-08d06898-1c8d-4e97-a0c5-001fbe6930e4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:38.502618 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-08d06898-1c8d-4e97-a0c5-001fbe6930e4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:38.506906 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5f6bae85-26f0-4503-8cc5-8c6489b975e5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:38.510052 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08d06898-1c8d-4e97-a0c5-001fbe6930e4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:38.510781 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08d06898-1c8d-4e97-a0c5-001fbe6930e4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:38.511681 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08d06898-1c8d-4e97-a0c5-001fbe6930e4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:38.512333 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08d06898-1c8d-4e97-a0c5-001fbe6930e4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:38.517828 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5f6bae85-26f0-4503-8cc5-8c6489b975e5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.179583 Jul 25 12:17:38.518465 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 226/459] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:38 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:38.889275 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-08d06898-1c8d-4e97-a0c5-001fbe6930e4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:38.898290 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-08d06898-1c8d-4e97-a0c5-001fbe6930e4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:38.899894 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-08d06898-1c8d-4e97-a0c5-001fbe6930e4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:38.901058 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-08d06898-1c8d-4e97-a0c5-001fbe6930e4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.403671 Jul 25 12:17:38.901614 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 234/460] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:38 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:39.540411 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9757307c-1a78-4d2f-915a-fd049aceb04d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:39.541001 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9757307c-1a78-4d2f-915a-fd049aceb04d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:39.548471 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9757307c-1a78-4d2f-915a-fd049aceb04d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:39.548919 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9757307c-1a78-4d2f-915a-fd049aceb04d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:39.549688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9757307c-1a78-4d2f-915a-fd049aceb04d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:39.550114 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9757307c-1a78-4d2f-915a-fd049aceb04d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:39.699137 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9757307c-1a78-4d2f-915a-fd049aceb04d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:39.708035 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9757307c-1a78-4d2f-915a-fd049aceb04d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.171389 Jul 25 12:17:39.708779 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 227/461] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:39 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:39.926286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c64e8ed3-ebcd-467b-948e-69a26b78b2ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:39.926879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c64e8ed3-ebcd-467b-948e-69a26b78b2ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:39.933701 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c64e8ed3-ebcd-467b-948e-69a26b78b2ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:39.934159 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c64e8ed3-ebcd-467b-948e-69a26b78b2ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:39.934977 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c64e8ed3-ebcd-467b-948e-69a26b78b2ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:39.935443 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c64e8ed3-ebcd-467b-948e-69a26b78b2ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:40.081162 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c64e8ed3-ebcd-467b-948e-69a26b78b2ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:40.090027 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c64e8ed3-ebcd-467b-948e-69a26b78b2ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:40.091575 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c64e8ed3-ebcd-467b-948e-69a26b78b2ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:40.092801 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c64e8ed3-ebcd-467b-948e-69a26b78b2ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.171038 Jul 25 12:17:40.094248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 235/462] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:39 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:40.729987 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7fe70377-896c-48d3-a457-e19fedb380ed tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:40.730844 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7fe70377-896c-48d3-a457-e19fedb380ed tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:40.737549 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7fe70377-896c-48d3-a457-e19fedb380ed tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:40.737953 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7fe70377-896c-48d3-a457-e19fedb380ed tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:40.738746 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7fe70377-896c-48d3-a457-e19fedb380ed tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:40.739186 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7fe70377-896c-48d3-a457-e19fedb380ed tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:40.897702 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7fe70377-896c-48d3-a457-e19fedb380ed tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:40.906183 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7fe70377-896c-48d3-a457-e19fedb380ed tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.180888 Jul 25 12:17:40.907274 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 228/463] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:40 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:41.116985 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a6b2f097-6b5f-4c9d-96cb-0740777b857f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:41.117611 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a6b2f097-6b5f-4c9d-96cb-0740777b857f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:41.124411 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a6b2f097-6b5f-4c9d-96cb-0740777b857f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:41.125582 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a6b2f097-6b5f-4c9d-96cb-0740777b857f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:41.126428 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a6b2f097-6b5f-4c9d-96cb-0740777b857f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:41.126871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a6b2f097-6b5f-4c9d-96cb-0740777b857f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:41.274471 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a6b2f097-6b5f-4c9d-96cb-0740777b857f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:41.284088 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a6b2f097-6b5f-4c9d-96cb-0740777b857f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:41.285616 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a6b2f097-6b5f-4c9d-96cb-0740777b857f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:41.286772 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a6b2f097-6b5f-4c9d-96cb-0740777b857f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.173864 Jul 25 12:17:41.287329 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 236/464] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:41 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:41.929008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-12720226-aab7-44ba-bd39-49d50ad6678b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:41.929602 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-12720226-aab7-44ba-bd39-49d50ad6678b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:41.936646 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12720226-aab7-44ba-bd39-49d50ad6678b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:41.937096 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12720226-aab7-44ba-bd39-49d50ad6678b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:41.938467 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12720226-aab7-44ba-bd39-49d50ad6678b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:41.938903 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-12720226-aab7-44ba-bd39-49d50ad6678b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:42.089347 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-12720226-aab7-44ba-bd39-49d50ad6678b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:42.097622 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-12720226-aab7-44ba-bd39-49d50ad6678b tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.172693 Jul 25 12:17:42.098527 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 229/465] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:41 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:42.310268 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bc556981-4b54-4926-8387-4f43c198dbbb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:42.310866 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bc556981-4b54-4926-8387-4f43c198dbbb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:42.317753 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bc556981-4b54-4926-8387-4f43c198dbbb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:42.318202 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bc556981-4b54-4926-8387-4f43c198dbbb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:42.318979 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bc556981-4b54-4926-8387-4f43c198dbbb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:42.319415 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bc556981-4b54-4926-8387-4f43c198dbbb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:42.452759 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bc556981-4b54-4926-8387-4f43c198dbbb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:42.461046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bc556981-4b54-4926-8387-4f43c198dbbb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:42.462543 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bc556981-4b54-4926-8387-4f43c198dbbb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:42.463715 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bc556981-4b54-4926-8387-4f43c198dbbb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.157349 Jul 25 12:17:42.464260 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 237/466] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:42 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:43.119281 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-905db500-bbf7-423a-acad-32f9b5a06e24 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:43.119924 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-905db500-bbf7-423a-acad-32f9b5a06e24 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:43.127129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-905db500-bbf7-423a-acad-32f9b5a06e24 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:43.127613 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-905db500-bbf7-423a-acad-32f9b5a06e24 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:43.128370 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-905db500-bbf7-423a-acad-32f9b5a06e24 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:43.128794 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-905db500-bbf7-423a-acad-32f9b5a06e24 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:43.270759 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-905db500-bbf7-423a-acad-32f9b5a06e24 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:43.284347 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-905db500-bbf7-423a-acad-32f9b5a06e24 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.168799 Jul 25 12:17:43.284980 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 230/467] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:43 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:43.487823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b00d2ed5-4d5d-416f-a576-2cd6e559318b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:43.488398 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b00d2ed5-4d5d-416f-a576-2cd6e559318b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:43.494801 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b00d2ed5-4d5d-416f-a576-2cd6e559318b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:43.495243 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b00d2ed5-4d5d-416f-a576-2cd6e559318b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:43.496025 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b00d2ed5-4d5d-416f-a576-2cd6e559318b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:43.496457 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b00d2ed5-4d5d-416f-a576-2cd6e559318b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:43.636604 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b00d2ed5-4d5d-416f-a576-2cd6e559318b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:43.645168 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b00d2ed5-4d5d-416f-a576-2cd6e559318b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:43.646679 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b00d2ed5-4d5d-416f-a576-2cd6e559318b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:43.647868 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b00d2ed5-4d5d-416f-a576-2cd6e559318b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.164502 Jul 25 12:17:43.648434 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 238/468] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:43 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:44.306140 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e306080f-70cd-4792-97d0-8dd726ee60f4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:44.306863 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e306080f-70cd-4792-97d0-8dd726ee60f4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:44.314777 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e306080f-70cd-4792-97d0-8dd726ee60f4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:44.315326 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e306080f-70cd-4792-97d0-8dd726ee60f4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:44.316388 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e306080f-70cd-4792-97d0-8dd726ee60f4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:44.316830 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e306080f-70cd-4792-97d0-8dd726ee60f4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:44.472976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e306080f-70cd-4792-97d0-8dd726ee60f4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:44.481620 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e306080f-70cd-4792-97d0-8dd726ee60f4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.179318 Jul 25 12:17:44.482468 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 231/469] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:44 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:44.672420 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1e752c07-e453-49ce-b7d0-74a36d632cd6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:44.673233 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1e752c07-e453-49ce-b7d0-74a36d632cd6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:44.680005 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e752c07-e453-49ce-b7d0-74a36d632cd6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:44.680446 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e752c07-e453-49ce-b7d0-74a36d632cd6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:44.681213 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e752c07-e453-49ce-b7d0-74a36d632cd6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:44.681645 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1e752c07-e453-49ce-b7d0-74a36d632cd6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:44.817115 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1e752c07-e453-49ce-b7d0-74a36d632cd6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:44.825671 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1e752c07-e453-49ce-b7d0-74a36d632cd6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:44.827189 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1e752c07-e453-49ce-b7d0-74a36d632cd6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:44.828455 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1e752c07-e453-49ce-b7d0-74a36d632cd6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.160128 Jul 25 12:17:44.829011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 239/470] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:44 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:45.503042 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d576df6f-04ee-4e30-ab91-78221c7d7609 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:45.503674 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d576df6f-04ee-4e30-ab91-78221c7d7609 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:45.506125 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=78 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:45.511595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d576df6f-04ee-4e30-ab91-78221c7d7609 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:45.512050 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d576df6f-04ee-4e30-ab91-78221c7d7609 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:45.512810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d576df6f-04ee-4e30-ab91-78221c7d7609 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:45.513276 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d576df6f-04ee-4e30-ab91-78221c7d7609 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:45.653385 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d576df6f-04ee-4e30-ab91-78221c7d7609 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:45.661493 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d576df6f-04ee-4e30-ab91-78221c7d7609 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.162870 Jul 25 12:17:45.662052 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 232/471] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:45 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:45.852676 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5a34fdcb-aa6b-4b37-a722-2b881533d6a6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:45.853289 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5a34fdcb-aa6b-4b37-a722-2b881533d6a6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:45.859809 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a34fdcb-aa6b-4b37-a722-2b881533d6a6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:45.860261 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a34fdcb-aa6b-4b37-a722-2b881533d6a6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:45.861023 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a34fdcb-aa6b-4b37-a722-2b881533d6a6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:45.861462 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5a34fdcb-aa6b-4b37-a722-2b881533d6a6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:45.990705 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5a34fdcb-aa6b-4b37-a722-2b881533d6a6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:45.998972 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5a34fdcb-aa6b-4b37-a722-2b881533d6a6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:46.000525 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5a34fdcb-aa6b-4b37-a722-2b881533d6a6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:46.002343 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5a34fdcb-aa6b-4b37-a722-2b881533d6a6 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.152932 Jul 25 12:17:46.002904 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 240/472] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:45 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:46.682183 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a11323a6-e3f5-4fe5-a612-fb0f0b1455d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:46.682787 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a11323a6-e3f5-4fe5-a612-fb0f0b1455d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:46.689961 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a11323a6-e3f5-4fe5-a612-fb0f0b1455d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:46.690406 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a11323a6-e3f5-4fe5-a612-fb0f0b1455d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:46.691163 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a11323a6-e3f5-4fe5-a612-fb0f0b1455d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:46.691626 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a11323a6-e3f5-4fe5-a612-fb0f0b1455d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:46.833655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a11323a6-e3f5-4fe5-a612-fb0f0b1455d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:46.841935 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:46.847662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a11323a6-e3f5-4fe5-a612-fb0f0b1455d9 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.169281 Jul 25 12:17:46.848242 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 233/473] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:46 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:47.025759 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7a27b541-5ef6-400f-8c20-df13f3a1f0b5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:47.026368 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7a27b541-5ef6-400f-8c20-df13f3a1f0b5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:47.034490 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7a27b541-5ef6-400f-8c20-df13f3a1f0b5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:47.034937 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7a27b541-5ef6-400f-8c20-df13f3a1f0b5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:47.035738 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7a27b541-5ef6-400f-8c20-df13f3a1f0b5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:47.036173 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7a27b541-5ef6-400f-8c20-df13f3a1f0b5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:47.167171 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7a27b541-5ef6-400f-8c20-df13f3a1f0b5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:47.176262 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7a27b541-5ef6-400f-8c20-df13f3a1f0b5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:47.177758 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7a27b541-5ef6-400f-8c20-df13f3a1f0b5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:47.178913 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7a27b541-5ef6-400f-8c20-df13f3a1f0b5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.157191 Jul 25 12:17:47.179473 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 241/474] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:47 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:47.869770 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-003ef4d9-712e-4429-ab92-e2bfc733836f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:47.870379 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-003ef4d9-712e-4429-ab92-e2bfc733836f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:47.878133 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-003ef4d9-712e-4429-ab92-e2bfc733836f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:47.878578 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-003ef4d9-712e-4429-ab92-e2bfc733836f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:47.879342 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-003ef4d9-712e-4429-ab92-e2bfc733836f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:47.879800 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-003ef4d9-712e-4429-ab92-e2bfc733836f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:48.026012 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-003ef4d9-712e-4429-ab92-e2bfc733836f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:48.035813 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-003ef4d9-712e-4429-ab92-e2bfc733836f tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.169778 Jul 25 12:17:48.036384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 234/475] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:47 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:48.202023 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6db7f496-d70a-40aa-93e1-9b9cb458b4b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:48.202636 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6db7f496-d70a-40aa-93e1-9b9cb458b4b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:48.209127 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6db7f496-d70a-40aa-93e1-9b9cb458b4b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:48.209578 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6db7f496-d70a-40aa-93e1-9b9cb458b4b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:48.210339 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6db7f496-d70a-40aa-93e1-9b9cb458b4b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:48.210779 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6db7f496-d70a-40aa-93e1-9b9cb458b4b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:48.339215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6db7f496-d70a-40aa-93e1-9b9cb458b4b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:48.347536 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6db7f496-d70a-40aa-93e1-9b9cb458b4b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:48.349053 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6db7f496-d70a-40aa-93e1-9b9cb458b4b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:48.350198 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6db7f496-d70a-40aa-93e1-9b9cb458b4b4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.152003 Jul 25 12:17:48.350746 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 242/476] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:48 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:49.057834 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-34920408-795a-4c8e-af14-082688ed0e04 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:49.058444 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-34920408-795a-4c8e-af14-082688ed0e04 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:49.065557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-34920408-795a-4c8e-af14-082688ed0e04 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:49.066002 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-34920408-795a-4c8e-af14-082688ed0e04 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:49.066762 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-34920408-795a-4c8e-af14-082688ed0e04 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:49.067188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-34920408-795a-4c8e-af14-082688ed0e04 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:49.205464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-34920408-795a-4c8e-af14-082688ed0e04 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:49.213291 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-34920408-795a-4c8e-af14-082688ed0e04 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.159396 Jul 25 12:17:49.213897 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 235/477] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:49 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:49.373053 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dfc1714e-ddb8-4f1f-a55a-0ae1a45500b9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:49.373599 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dfc1714e-ddb8-4f1f-a55a-0ae1a45500b9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:49.380305 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dfc1714e-ddb8-4f1f-a55a-0ae1a45500b9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:49.380757 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dfc1714e-ddb8-4f1f-a55a-0ae1a45500b9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:49.381519 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dfc1714e-ddb8-4f1f-a55a-0ae1a45500b9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:49.381958 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dfc1714e-ddb8-4f1f-a55a-0ae1a45500b9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:49.509973 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dfc1714e-ddb8-4f1f-a55a-0ae1a45500b9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:49.518436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dfc1714e-ddb8-4f1f-a55a-0ae1a45500b9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:49.519977 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dfc1714e-ddb8-4f1f-a55a-0ae1a45500b9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:49.521134 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dfc1714e-ddb8-4f1f-a55a-0ae1a45500b9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.152045 Jul 25 12:17:49.521700 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 243/478] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:49 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:50.234287 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-156591f2-2b91-4bf6-be53-11b8a6d89360 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:50.234917 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-156591f2-2b91-4bf6-be53-11b8a6d89360 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:50.241975 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-156591f2-2b91-4bf6-be53-11b8a6d89360 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:50.242436 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-156591f2-2b91-4bf6-be53-11b8a6d89360 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:50.243179 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-156591f2-2b91-4bf6-be53-11b8a6d89360 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:50.243638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-156591f2-2b91-4bf6-be53-11b8a6d89360 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:50.545241 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-af7a5127-5e8f-4ed3-9959-0adc7b353ff5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:50.545851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-af7a5127-5e8f-4ed3-9959-0adc7b353ff5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:50.552534 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af7a5127-5e8f-4ed3-9959-0adc7b353ff5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:50.552980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af7a5127-5e8f-4ed3-9959-0adc7b353ff5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:50.553752 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af7a5127-5e8f-4ed3-9959-0adc7b353ff5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:50.554185 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af7a5127-5e8f-4ed3-9959-0adc7b353ff5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:50.599770 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-156591f2-2b91-4bf6-be53-11b8a6d89360 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:50.607658 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-156591f2-2b91-4bf6-be53-11b8a6d89360 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.377241 Jul 25 12:17:50.608229 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 236/479] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:50 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:50.683599 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-af7a5127-5e8f-4ed3-9959-0adc7b353ff5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:50.691862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-af7a5127-5e8f-4ed3-9959-0adc7b353ff5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:50.693349 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-af7a5127-5e8f-4ed3-9959-0adc7b353ff5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:50.694499 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-af7a5127-5e8f-4ed3-9959-0adc7b353ff5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.153202 Jul 25 12:17:50.695052 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 244/480] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:50 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:51.628671 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-260a315f-2754-4516-b2bf-73f9a6e4b808 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:51.629267 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-260a315f-2754-4516-b2bf-73f9a6e4b808 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:51.635723 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-260a315f-2754-4516-b2bf-73f9a6e4b808 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:51.636199 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-260a315f-2754-4516-b2bf-73f9a6e4b808 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:51.636952 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-260a315f-2754-4516-b2bf-73f9a6e4b808 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:51.637384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-260a315f-2754-4516-b2bf-73f9a6e4b808 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:51.718100 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e4ae6b0c-6142-4754-aeb2-a7ddbd71e760 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:51.718738 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e4ae6b0c-6142-4754-aeb2-a7ddbd71e760 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:51.725880 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4ae6b0c-6142-4754-aeb2-a7ddbd71e760 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:51.726330 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4ae6b0c-6142-4754-aeb2-a7ddbd71e760 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:51.727091 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4ae6b0c-6142-4754-aeb2-a7ddbd71e760 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:51.727535 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e4ae6b0c-6142-4754-aeb2-a7ddbd71e760 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:51.788758 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-260a315f-2754-4516-b2bf-73f9a6e4b808 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:51.797254 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-260a315f-2754-4516-b2bf-73f9a6e4b808 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1756 microversion: 2.1 time: 0.172422 Jul 25 12:17:51.797839 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 237/481] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:51 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:17:51.865447 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e4ae6b0c-6142-4754-aeb2-a7ddbd71e760 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:51.873737 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e4ae6b0c-6142-4754-aeb2-a7ddbd71e760 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:51.875238 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e4ae6b0c-6142-4754-aeb2-a7ddbd71e760 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:51.876433 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e4ae6b0c-6142-4754-aeb2-a7ddbd71e760 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.162160 Jul 25 12:17:51.876989 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 245/482] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:51 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:52.818715 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cb370ef7-e291-4a98-bd43-609a6ba8f22a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:52.819324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cb370ef7-e291-4a98-bd43-609a6ba8f22a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:52.826095 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cb370ef7-e291-4a98-bd43-609a6ba8f22a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:52.826542 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cb370ef7-e291-4a98-bd43-609a6ba8f22a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:52.827295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cb370ef7-e291-4a98-bd43-609a6ba8f22a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:52.827770 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cb370ef7-e291-4a98-bd43-609a6ba8f22a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:52.900521 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7d0b3149-8cc9-4b20-a1af-83c3dd2bf64f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:52.901063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7d0b3149-8cc9-4b20-a1af-83c3dd2bf64f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:52.907995 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d0b3149-8cc9-4b20-a1af-83c3dd2bf64f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:52.908446 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d0b3149-8cc9-4b20-a1af-83c3dd2bf64f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:52.909510 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d0b3149-8cc9-4b20-a1af-83c3dd2bf64f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:52.910197 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d0b3149-8cc9-4b20-a1af-83c3dd2bf64f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:52.971680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cb370ef7-e291-4a98-bd43-609a6ba8f22a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:52.979851 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cb370ef7-e291-4a98-bd43-609a6ba8f22a tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1759 microversion: 2.1 time: 0.164847 Jul 25 12:17:52.980592 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 238/483] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:17:52 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:17:53.042887 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7d0b3149-8cc9-4b20-a1af-83c3dd2bf64f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:53.052035 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7d0b3149-8cc9-4b20-a1af-83c3dd2bf64f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:53.053547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7d0b3149-8cc9-4b20-a1af-83c3dd2bf64f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:53.054701 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7d0b3149-8cc9-4b20-a1af-83c3dd2bf64f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.158216 Jul 25 12:17:53.055266 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 246/484] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:52 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:54.077756 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8118ead7-2835-4387-9ba4-e0ef54f32b47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:54.078371 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8118ead7-2835-4387-9ba4-e0ef54f32b47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:54.084969 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8118ead7-2835-4387-9ba4-e0ef54f32b47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:54.085419 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8118ead7-2835-4387-9ba4-e0ef54f32b47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:54.086177 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8118ead7-2835-4387-9ba4-e0ef54f32b47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:54.086615 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8118ead7-2835-4387-9ba4-e0ef54f32b47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:54.214277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8118ead7-2835-4387-9ba4-e0ef54f32b47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:54.224783 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8118ead7-2835-4387-9ba4-e0ef54f32b47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:54.226398 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8118ead7-2835-4387-9ba4-e0ef54f32b47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:54.227595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8118ead7-2835-4387-9ba4-e0ef54f32b47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.153754 Jul 25 12:17:54.228159 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 239/485] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:54 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:55.250894 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e9bd78b3-00af-407e-8a8b-489c3dbff048 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:55.252339 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e9bd78b3-00af-407e-8a8b-489c3dbff048 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:55.256238 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=64 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:55.262152 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e9bd78b3-00af-407e-8a8b-489c3dbff048 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:55.262643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e9bd78b3-00af-407e-8a8b-489c3dbff048 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:55.263398 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e9bd78b3-00af-407e-8a8b-489c3dbff048 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:55.263900 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e9bd78b3-00af-407e-8a8b-489c3dbff048 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:55.393748 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e9bd78b3-00af-407e-8a8b-489c3dbff048 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:55.402005 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e9bd78b3-00af-407e-8a8b-489c3dbff048 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:55.403507 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e9bd78b3-00af-407e-8a8b-489c3dbff048 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:55.404679 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e9bd78b3-00af-407e-8a8b-489c3dbff048 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.157772 Jul 25 12:17:55.405228 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 247/486] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:55 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:56.428698 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-06258b38-87de-4c1e-aea2-6ec90bab1277 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:56.429303 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-06258b38-87de-4c1e-aea2-6ec90bab1277 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:56.436256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06258b38-87de-4c1e-aea2-6ec90bab1277 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:56.436710 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06258b38-87de-4c1e-aea2-6ec90bab1277 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:56.437476 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06258b38-87de-4c1e-aea2-6ec90bab1277 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:56.437913 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06258b38-87de-4c1e-aea2-6ec90bab1277 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:56.513126 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-c3c3a586-af21-4f88-be9c-6b3aa72ff522 req-9ecdfb56-5d53-4942-a44a-0ef1902ea9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66654721-31e2-48d8-a0ea-c146d277ab47", "name": "network-vif-plugged", "status": "completed", "tag": "d01f3ff0-df08-4605-a057-7920ee080060"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:17:56.526414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-c3c3a586-af21-4f88-be9c-6b3aa72ff522 req-9ecdfb56-5d53-4942-a44a-0ef1902ea9d0 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:56.527028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-c3c3a586-af21-4f88-be9c-6b3aa72ff522 req-9ecdfb56-5d53-4942-a44a-0ef1902ea9d0 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:56.530932 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:56.541447 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-c3c3a586-af21-4f88-be9c-6b3aa72ff522 req-9ecdfb56-5d53-4942-a44a-0ef1902ea9d0 service nova] Creating event network-vif-plugged:d01f3ff0-df08-4605-a057-7920ee080060 for instance 66654721-31e2-48d8-a0ea-c146d277ab47 on hv-cinder-79760 Jul 25 12:17:56.547423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-c3c3a586-af21-4f88-be9c-6b3aa72ff522 req-9ecdfb56-5d53-4942-a44a-0ef1902ea9d0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037780 Jul 25 12:17:56.548093 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 248/487] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:17:56.583150 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-06258b38-87de-4c1e-aea2-6ec90bab1277 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:56.596283 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-06258b38-87de-4c1e-aea2-6ec90bab1277 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:56.597904 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-06258b38-87de-4c1e-aea2-6ec90bab1277 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:56.599062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-06258b38-87de-4c1e-aea2-6ec90bab1277 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.174413 Jul 25 12:17:56.599631 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 240/488] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:56 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:57.623077 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e764c756-84d7-4151-aaa6-0a43d2b66341 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:57.623923 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e764c756-84d7-4151-aaa6-0a43d2b66341 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:57.630604 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e764c756-84d7-4151-aaa6-0a43d2b66341 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:57.631051 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e764c756-84d7-4151-aaa6-0a43d2b66341 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:57.631844 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e764c756-84d7-4151-aaa6-0a43d2b66341 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:57.632277 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e764c756-84d7-4151-aaa6-0a43d2b66341 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:57.760923 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e764c756-84d7-4151-aaa6-0a43d2b66341 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:57.769287 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e764c756-84d7-4151-aaa6-0a43d2b66341 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:57.770792 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e764c756-84d7-4151-aaa6-0a43d2b66341 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:57.771977 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e764c756-84d7-4151-aaa6-0a43d2b66341 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.153140 Jul 25 12:17:57.772534 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 249/489] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:57 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:17:58.796126 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-67e0e810-15da-41b0-9b4e-59b108c4fd57 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:58.796728 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-67e0e810-15da-41b0-9b4e-59b108c4fd57 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:58.803456 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67e0e810-15da-41b0-9b4e-59b108c4fd57 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:58.803944 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67e0e810-15da-41b0-9b4e-59b108c4fd57 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:58.804698 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67e0e810-15da-41b0-9b4e-59b108c4fd57 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:58.805130 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67e0e810-15da-41b0-9b4e-59b108c4fd57 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:58.941399 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-67e0e810-15da-41b0-9b4e-59b108c4fd57 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:58.950555 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-67e0e810-15da-41b0-9b4e-59b108c4fd57 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:58.952313 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-67e0e810-15da-41b0-9b4e-59b108c4fd57 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:17:58.953440 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-67e0e810-15da-41b0-9b4e-59b108c4fd57 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1807 microversion: 2.20 time: 0.161184 Jul 25 12:17:58.954287 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 241/490] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:58 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:17:59.977807 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-67a1df4d-8115-4fc6-857a-255ad839a76a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:17:59.978405 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-67a1df4d-8115-4fc6-857a-255ad839a76a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:17:59.984834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67a1df4d-8115-4fc6-857a-255ad839a76a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:59.985286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67a1df4d-8115-4fc6-857a-255ad839a76a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:17:59.986038 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67a1df4d-8115-4fc6-857a-255ad839a76a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:17:59.987110 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-67a1df4d-8115-4fc6-857a-255ad839a76a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:00.112387 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-67a1df4d-8115-4fc6-857a-255ad839a76a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:00.120723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-67a1df4d-8115-4fc6-857a-255ad839a76a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:00.122224 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-67a1df4d-8115-4fc6-857a-255ad839a76a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:00.123381 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-67a1df4d-8115-4fc6-857a-255ad839a76a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1794 microversion: 2.20 time: 0.149506 Jul 25 12:18:00.123990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 250/491] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:17:59 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1794 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:18:18.178035 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-deaae063-9312-45d8-b6d8-768def765d12 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:18.178626 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-deaae063-9312-45d8-b6d8-768def765d12 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:18.180755 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=19 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:18.181401 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=48 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:18.186976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-deaae063-9312-45d8-b6d8-768def765d12 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:18.187419 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-deaae063-9312-45d8-b6d8-768def765d12 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:18.188873 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-deaae063-9312-45d8-b6d8-768def765d12 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:18.189333 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-deaae063-9312-45d8-b6d8-768def765d12 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:18.310887 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-deaae063-9312-45d8-b6d8-768def765d12 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lazy-loading 'services' on Instance uuid 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:18:18.420684 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-deaae063-9312-45d8-b6d8-768def765d12 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/os-volume_attachments/38ada32b-2a99-4325-ac8c-18f3099d39f3" status: 202 len: 0 microversion: 2.1 time: 0.246403 Jul 25 12:18:18.421573 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 242/492] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Jul 25 12:18:18 2022] DELETE /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/os-volume_attachments/38ada32b-2a99-4325-ac8c-18f3099d39f3 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:18:19.208007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3957bb22-7677-45a9-833b-5e11a9aef0cb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:19.208561 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3957bb22-7677-45a9-833b-5e11a9aef0cb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:19.210685 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=7 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:19.211335 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=12 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:19.217567 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3957bb22-7677-45a9-833b-5e11a9aef0cb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:19.218016 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3957bb22-7677-45a9-833b-5e11a9aef0cb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:19.218781 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3957bb22-7677-45a9-833b-5e11a9aef0cb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:19.219331 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3957bb22-7677-45a9-833b-5e11a9aef0cb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:19.242025 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3957bb22-7677-45a9-833b-5e11a9aef0cb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720/ips" status: 200 len: 150 microversion: 2.1 time: 0.038587 Jul 25 12:18:19.242573 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 251/493] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Jul 25 12:18:19 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:19.255125 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a92764a4-c486-4586-b7bb-09cf9169ae58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "816e15b4-639a-48ea-928b-c639df47cdf7"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:19.257832 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a92764a4-c486-4586-b7bb-09cf9169ae58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:19.265178 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a92764a4-c486-4586-b7bb-09cf9169ae58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:19.265623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a92764a4-c486-4586-b7bb-09cf9169ae58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:19.267026 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a92764a4-c486-4586-b7bb-09cf9169ae58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:19.267458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a92764a4-c486-4586-b7bb-09cf9169ae58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:19.351227 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-a92764a4-c486-4586-b7bb-09cf9169ae58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Invalid volume: volume 816e15b4-639a-48ea-928b-c639df47cdf7 is already attached to instances: 3d50aae7-fb06-467c-9a21-1d683297bc9e Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a92764a4-c486-4586-b7bb-09cf9169ae58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: POST /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720/os-volume_attachments HTTP/1.1 Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 74 Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:18:19.354557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:18:19.356250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:18:19.356250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:18:19.356250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:18:19.356250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:18:19.356250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:18:19.356250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:18:19.356250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:18:19.356250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:18:19.356250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:18:19.356250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Jul 25 12:18:19.356250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {"volumeAttachment": {"volumeId": "816e15b4-639a-48ea-928b-c639df47cdf7"}} Jul 25 12:18:19.356250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Invalid volume: volume 816e15b4-639a-48ea-928b-c639df47cdf7 is already attached to instances: 3d50aae7-fb06-467c-9a21-1d683297bc9e Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'server_id': '484cf6bc-2993-476c-ab86-45ac7e109720', 'body': {'volumeAttachment': {'volumeId': '816e15b4-639a-48ea-928b-c639df47cdf7'}}} Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 816e15b4-639a-48ea-928b-c639df47cdf7 is already attached to instances: 3d50aae7-fb06-467c-9a21-1d683297bc9e Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:19.357047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 816e15b4-639a-48ea-928b-c639df47cdf7 is already attached to instances: 3d50aae7-fb06-467c-9a21-1d683297bc9e Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:19.359384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:19.360839 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:19.360839 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:18:19.360839 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:18:19.360839 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 816e15b4-639a-48ea-928b-c639df47cdf7 is already attached to instances: 3d50aae7-fb06-467c-9a21-1d683297bc9e Jul 25 12:18:19.360839 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:19.360839 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a92764a4-c486-4586-b7bb-09cf9169ae58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 400 to user: Invalid volume: volume 816e15b4-639a-48ea-928b-c639df47cdf7 is already attached to instances: 3d50aae7-fb06-467c-9a21-1d683297bc9e {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:18:19.360839 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a92764a4-c486-4586-b7bb-09cf9169ae58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "POST /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108161 Jul 25 12:18:19.360839 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 243/494] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:18:19 2022] POST /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:18:19.369229 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-82560f46-2d92-47a8-bc5d-f1fbb7f17539 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:19.369852 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-82560f46-2d92-47a8-bc5d-f1fbb7f17539 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:19.376385 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-82560f46-2d92-47a8-bc5d-f1fbb7f17539 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:19.376837 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-82560f46-2d92-47a8-bc5d-f1fbb7f17539 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:19.377600 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-82560f46-2d92-47a8-bc5d-f1fbb7f17539 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:19.378035 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-82560f46-2d92-47a8-bc5d-f1fbb7f17539 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:19.403535 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-82560f46-2d92-47a8-bc5d-f1fbb7f17539 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:18:19.481288 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-82560f46-2d92-47a8-bc5d-f1fbb7f17539 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 204 len: 0 microversion: 2.1 time: 0.115453 Jul 25 12:18:19.484181 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 252/495] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:18:19 2022] DELETE /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:18:19.492132 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-19c539ba-2b65-4ed9-b03d-603f3118050a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:19.492745 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-19c539ba-2b65-4ed9-b03d-603f3118050a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:19.499184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19c539ba-2b65-4ed9-b03d-603f3118050a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:19.499655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19c539ba-2b65-4ed9-b03d-603f3118050a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:19.500412 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19c539ba-2b65-4ed9-b03d-603f3118050a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:19.501331 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19c539ba-2b65-4ed9-b03d-603f3118050a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:19.540049 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4f41a7ac-f4ec-43a5-b5be-d3eca3355a6e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:19.546310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f41a7ac-f4ec-43a5-b5be-d3eca3355a6e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:19.546758 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f41a7ac-f4ec-43a5-b5be-d3eca3355a6e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:19.608584 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4f41a7ac-f4ec-43a5-b5be-d3eca3355a6e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Going to try to stop instance {{(pid=117777) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 12:18:19.631719 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-19c539ba-2b65-4ed9-b03d-603f3118050a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:19.640588 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-19c539ba-2b65-4ed9-b03d-603f3118050a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1683 microversion: 2.1 time: 0.152184 Jul 25 12:18:19.641420 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 244/496] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:19 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:19.658289 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4f41a7ac-f4ec-43a5-b5be-d3eca3355a6e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "POST /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/action" status: 202 len: 0 microversion: 2.1 time: 0.122286 Jul 25 12:18:19.658820 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 253/497] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:18:19 2022] POST /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:18:19.666499 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7cc9b780-1f48-419f-bb81-7482891c1517 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:19.667102 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7cc9b780-1f48-419f-bb81-7482891c1517 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:19.673689 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cc9b780-1f48-419f-bb81-7482891c1517 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:19.674127 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cc9b780-1f48-419f-bb81-7482891c1517 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:19.674874 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cc9b780-1f48-419f-bb81-7482891c1517 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:19.675301 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7cc9b780-1f48-419f-bb81-7482891c1517 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:19.800981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7cc9b780-1f48-419f-bb81-7482891c1517 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:19.808398 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7cc9b780-1f48-419f-bb81-7482891c1517 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1676 microversion: 2.1 time: 0.145567 Jul 25 12:18:19.808941 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 245/498] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:19 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:20.665031 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d953a949-2cf1-46a8-a7a2-1044f90837be tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:20.665734 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d953a949-2cf1-46a8-a7a2-1044f90837be tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:20.672040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d953a949-2cf1-46a8-a7a2-1044f90837be tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:20.673150 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d953a949-2cf1-46a8-a7a2-1044f90837be tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:20.673983 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d953a949-2cf1-46a8-a7a2-1044f90837be tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:20.674421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d953a949-2cf1-46a8-a7a2-1044f90837be tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:20.807815 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d953a949-2cf1-46a8-a7a2-1044f90837be tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:20.815746 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d953a949-2cf1-46a8-a7a2-1044f90837be tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1683 microversion: 2.1 time: 0.155527 Jul 25 12:18:20.816307 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 254/499] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:20 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:20.830519 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1848de66-a7cb-4bed-b568-95d002311408 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:20.831129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1848de66-a7cb-4bed-b568-95d002311408 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:20.837601 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1848de66-a7cb-4bed-b568-95d002311408 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:20.838053 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1848de66-a7cb-4bed-b568-95d002311408 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:20.838808 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1848de66-a7cb-4bed-b568-95d002311408 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:20.839241 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1848de66-a7cb-4bed-b568-95d002311408 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:20.976054 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1848de66-a7cb-4bed-b568-95d002311408 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:20.983593 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1848de66-a7cb-4bed-b568-95d002311408 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1676 microversion: 2.1 time: 0.157439 Jul 25 12:18:20.984351 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 246/500] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:20 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:21.837324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d17aeb22-d916-4feb-ae8b-f13db45c70db tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:21.837939 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d17aeb22-d916-4feb-ae8b-f13db45c70db tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:21.845148 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d17aeb22-d916-4feb-ae8b-f13db45c70db tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:21.845604 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d17aeb22-d916-4feb-ae8b-f13db45c70db tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:21.846385 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d17aeb22-d916-4feb-ae8b-f13db45c70db tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:21.846823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d17aeb22-d916-4feb-ae8b-f13db45c70db tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:21.913654 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d17aeb22-d916-4feb-ae8b-f13db45c70db tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:21.921347 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d17aeb22-d916-4feb-ae8b-f13db45c70db tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 200 len: 1615 microversion: 2.1 time: 0.087868 Jul 25 12:18:21.926077 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 255/501] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:21 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:22.005970 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3b9e777d-24b1-445c-8317-f008707277d4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:22.006930 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3b9e777d-24b1-445c-8317-f008707277d4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:22.014240 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3b9e777d-24b1-445c-8317-f008707277d4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:22.014694 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3b9e777d-24b1-445c-8317-f008707277d4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:22.015746 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3b9e777d-24b1-445c-8317-f008707277d4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:22.016677 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3b9e777d-24b1-445c-8317-f008707277d4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:22.127375 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-727fd351-4d8c-4af9-89ab-2654fc5f39d0 req-19de8c64-3821-40bb-b307-e7113a414770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484cf6bc-2993-476c-ab86-45ac7e109720", "name": "network-vif-deleted", "tag": "9251fe67-d381-42a4-95a5-12fffca6f2be"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:22.150489 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-727fd351-4d8c-4af9-89ab-2654fc5f39d0 req-19de8c64-3821-40bb-b307-e7113a414770 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:22.151440 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-727fd351-4d8c-4af9-89ab-2654fc5f39d0 req-19de8c64-3821-40bb-b307-e7113a414770 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:22.169856 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-727fd351-4d8c-4af9-89ab-2654fc5f39d0 req-19de8c64-3821-40bb-b307-e7113a414770 service nova] Creating event network-vif-deleted:9251fe67-d381-42a4-95a5-12fffca6f2be for instance 484cf6bc-2993-476c-ab86-45ac7e109720 on hv-cinder-79760 Jul 25 12:18:22.176040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-727fd351-4d8c-4af9-89ab-2654fc5f39d0 req-19de8c64-3821-40bb-b307-e7113a414770 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052040 Jul 25 12:18:22.176391 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 256/502] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:22.201340 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3b9e777d-24b1-445c-8317-f008707277d4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:22.212855 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3b9e777d-24b1-445c-8317-f008707277d4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1676 microversion: 2.1 time: 0.211801 Jul 25 12:18:22.220286 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 247/503] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:21 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:22.943314 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-60618a5b-3f8d-4142-b3bb-2129b78eea98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:22.951378 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-60618a5b-3f8d-4142-b3bb-2129b78eea98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:22.958585 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60618a5b-3f8d-4142-b3bb-2129b78eea98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:22.959086 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60618a5b-3f8d-4142-b3bb-2129b78eea98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:22.959892 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60618a5b-3f8d-4142-b3bb-2129b78eea98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:22.960331 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60618a5b-3f8d-4142-b3bb-2129b78eea98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:22.974411 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-60618a5b-3f8d-4142-b3bb-2129b78eea98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-60618a5b-3f8d-4142-b3bb-2129b78eea98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 HTTP/1.1 Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:18:22.976146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:18:22.977438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:18:22.977438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:18:22.977438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:18:22.977438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:18:22.977438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:18:22.977438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:18:22.977438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:18:22.977438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:18:22.977438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:18:22.977438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:18:22.977438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:18:22.977438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '484cf6bc-2993-476c-ab86-45ac7e109720'} Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:18:22.978183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:18:22.979954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:22.981416 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-60618a5b-3f8d-4142-b3bb-2129b78eea98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 404 to user: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:18:22.981416 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-60618a5b-3f8d-4142-b3bb-2129b78eea98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 404 len: 111 microversion: 2.1 time: 0.038452 Jul 25 12:18:22.986878 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2fcc6b7f-ee04-44ba-8c5c-18fde7fed5d1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '.version_select at 0x7f942c5883a0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:22.991851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 257/504] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:22 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:18:23.010196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2fcc6b7f-ee04-44ba-8c5c-18fde7fed5d1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319134391" status: 202 len: 0 microversion: 2.1 time: 0.027505 Jul 25 12:18:23.014766 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 248/505] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Jul 25 12:18:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319134391 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:18:23.240340 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-904f7e4f-9f7a-48cb-bb49-85a3301f253d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:23.240966 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-904f7e4f-9f7a-48cb-bb49-85a3301f253d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:23.257049 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-904f7e4f-9f7a-48cb-bb49-85a3301f253d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:23.257507 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-904f7e4f-9f7a-48cb-bb49-85a3301f253d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:23.258300 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-904f7e4f-9f7a-48cb-bb49-85a3301f253d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:23.263243 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-904f7e4f-9f7a-48cb-bb49-85a3301f253d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:23.311784 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e06bd0e6-062a-48c3-835f-cb60fb454676 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7343d37-1595-4927-a7c7-152ce059d9e3"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:23.314682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e06bd0e6-062a-48c3-835f-cb60fb454676 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:23.327809 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e06bd0e6-062a-48c3-835f-cb60fb454676 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:23.328586 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e06bd0e6-062a-48c3-835f-cb60fb454676 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:23.329620 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e06bd0e6-062a-48c3-835f-cb60fb454676 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:23.330261 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e06bd0e6-062a-48c3-835f-cb60fb454676 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:23.462876 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-904f7e4f-9f7a-48cb-bb49-85a3301f253d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:23.478540 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-904f7e4f-9f7a-48cb-bb49-85a3301f253d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1676 microversion: 2.1 time: 0.248089 Jul 25 12:18:23.483262 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 258/506] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:23 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1676 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:23.661434 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e06bd0e6-062a-48c3-835f-cb60fb454676 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "POST /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355907 Jul 25 12:18:23.662226 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 249/507] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:18:23 2022] POST /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:23.918384 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e995b5ac-e8cf-42df-93f0-88ec8a08f228 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:23.919080 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e995b5ac-e8cf-42df-93f0-88ec8a08f228 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:23.925970 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e995b5ac-e8cf-42df-93f0-88ec8a08f228 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:23.926422 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e995b5ac-e8cf-42df-93f0-88ec8a08f228 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:23.927198 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e995b5ac-e8cf-42df-93f0-88ec8a08f228 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:23.927663 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e995b5ac-e8cf-42df-93f0-88ec8a08f228 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:24.064279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-e995b5ac-e8cf-42df-93f0-88ec8a08f228 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lazy-loading 'services' on Instance uuid 3d50aae7-fb06-467c-9a21-1d683297bc9e {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:18:24.180875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e995b5ac-e8cf-42df-93f0-88ec8a08f228 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments/816e15b4-639a-48ea-928b-c639df47cdf7" status: 202 len: 0 microversion: 2.1 time: 0.266427 Jul 25 12:18:24.181625 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 259/508] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Jul 25 12:18:23 2022] DELETE /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments/816e15b4-639a-48ea-928b-c639df47cdf7 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:18:24.191930 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d30c8e1f-c82f-4bc1-a4d4-5bcaeb67e90c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:24.194829 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d30c8e1f-c82f-4bc1-a4d4-5bcaeb67e90c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:24.201487 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d30c8e1f-c82f-4bc1-a4d4-5bcaeb67e90c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:24.202003 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d30c8e1f-c82f-4bc1-a4d4-5bcaeb67e90c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:24.202846 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d30c8e1f-c82f-4bc1-a4d4-5bcaeb67e90c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:24.203473 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d30c8e1f-c82f-4bc1-a4d4-5bcaeb67e90c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:24.233425 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d30c8e1f-c82f-4bc1-a4d4-5bcaeb67e90c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047288 Jul 25 12:18:24.238744 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 250/509] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:18:24 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:24.500900 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b3d49a15-88f1-4bf5-b8e5-4feff1a42335 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:24.501593 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b3d49a15-88f1-4bf5-b8e5-4feff1a42335 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:24.507889 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3d49a15-88f1-4bf5-b8e5-4feff1a42335 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:24.508338 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3d49a15-88f1-4bf5-b8e5-4feff1a42335 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:24.509092 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3d49a15-88f1-4bf5-b8e5-4feff1a42335 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:24.509524 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b3d49a15-88f1-4bf5-b8e5-4feff1a42335 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:24.645701 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b3d49a15-88f1-4bf5-b8e5-4feff1a42335 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:24.653736 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b3d49a15-88f1-4bf5-b8e5-4feff1a42335 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1676 microversion: 2.1 time: 0.157461 Jul 25 12:18:24.654638 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 260/510] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:24 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:25.246354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c1d48fd3-6ccd-48f0-863c-8bff02375f36 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:25.248459 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c1d48fd3-6ccd-48f0-863c-8bff02375f36 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:25.255460 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1d48fd3-6ccd-48f0-863c-8bff02375f36 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:25.255939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1d48fd3-6ccd-48f0-863c-8bff02375f36 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:25.256682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1d48fd3-6ccd-48f0-863c-8bff02375f36 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:25.257109 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c1d48fd3-6ccd-48f0-863c-8bff02375f36 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:25.285684 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c1d48fd3-6ccd-48f0-863c-8bff02375f36 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043309 Jul 25 12:18:25.286220 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 251/511] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:18:25 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:25.674814 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9e63eba8-a54b-4c6c-866f-db086cec97c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:25.675442 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9e63eba8-a54b-4c6c-866f-db086cec97c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:25.682168 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9e63eba8-a54b-4c6c-866f-db086cec97c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:25.682621 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9e63eba8-a54b-4c6c-866f-db086cec97c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:25.683380 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9e63eba8-a54b-4c6c-866f-db086cec97c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:25.683847 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9e63eba8-a54b-4c6c-866f-db086cec97c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:25.810152 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9e63eba8-a54b-4c6c-866f-db086cec97c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:25.817512 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9e63eba8-a54b-4c6c-866f-db086cec97c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1676 microversion: 2.1 time: 0.146494 Jul 25 12:18:25.818390 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 261/512] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:25 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:26.301533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d69d57f3-dd0a-42bf-833a-ae337d7b92a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:26.303705 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d69d57f3-dd0a-42bf-833a-ae337d7b92a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:26.310262 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d69d57f3-dd0a-42bf-833a-ae337d7b92a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:26.310714 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d69d57f3-dd0a-42bf-833a-ae337d7b92a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:26.311457 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d69d57f3-dd0a-42bf-833a-ae337d7b92a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:26.311906 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d69d57f3-dd0a-42bf-833a-ae337d7b92a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:26.342177 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d69d57f3-dd0a-42bf-833a-ae337d7b92a1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044551 Jul 25 12:18:26.342736 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 252/513] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:18:26 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:26.840119 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-66db4962-d989-46f6-a49c-54a739aadf74 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:26.840724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-66db4962-d989-46f6-a49c-54a739aadf74 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:26.847884 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66db4962-d989-46f6-a49c-54a739aadf74 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:26.848376 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66db4962-d989-46f6-a49c-54a739aadf74 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:26.849162 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66db4962-d989-46f6-a49c-54a739aadf74 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:26.849604 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-66db4962-d989-46f6-a49c-54a739aadf74 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:26.994452 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-66db4962-d989-46f6-a49c-54a739aadf74 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:27.001806 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-66db4962-d989-46f6-a49c-54a739aadf74 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1676 microversion: 2.1 time: 0.166259 Jul 25 12:18:27.002374 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 262/514] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:26 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:27.353665 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cbc20eed-409a-4a86-ba43-26d820488400 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:27.355807 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cbc20eed-409a-4a86-ba43-26d820488400 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:27.362352 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbc20eed-409a-4a86-ba43-26d820488400 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:27.362802 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbc20eed-409a-4a86-ba43-26d820488400 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:27.363571 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbc20eed-409a-4a86-ba43-26d820488400 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:27.364017 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cbc20eed-409a-4a86-ba43-26d820488400 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:27.393838 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cbc20eed-409a-4a86-ba43-26d820488400 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044121 Jul 25 12:18:27.394387 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 253/515] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:18:27 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:28.022467 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f32c3315-6a54-499e-8d47-14dbebbf1a27 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:28.023076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f32c3315-6a54-499e-8d47-14dbebbf1a27 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:28.029466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f32c3315-6a54-499e-8d47-14dbebbf1a27 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:28.029914 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f32c3315-6a54-499e-8d47-14dbebbf1a27 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:28.030972 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f32c3315-6a54-499e-8d47-14dbebbf1a27 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:28.031357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f32c3315-6a54-499e-8d47-14dbebbf1a27 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:28.161774 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f32c3315-6a54-499e-8d47-14dbebbf1a27 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:28.169128 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f32c3315-6a54-499e-8d47-14dbebbf1a27 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1676 microversion: 2.1 time: 0.150472 Jul 25 12:18:28.169689 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 263/516] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:28 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:28.406593 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a4d5fec2-7ef0-459f-9ba0-cc31999d63b5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:28.408700 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a4d5fec2-7ef0-459f-9ba0-cc31999d63b5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:28.415154 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4d5fec2-7ef0-459f-9ba0-cc31999d63b5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:28.415636 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4d5fec2-7ef0-459f-9ba0-cc31999d63b5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:28.416379 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4d5fec2-7ef0-459f-9ba0-cc31999d63b5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:28.416804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a4d5fec2-7ef0-459f-9ba0-cc31999d63b5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:28.445656 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a4d5fec2-7ef0-459f-9ba0-cc31999d63b5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043665 Jul 25 12:18:28.446238 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 254/517] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:18:28 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:29.191324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8f19b4bc-f42f-4616-bbd0-8c488e7d0843 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:29.191987 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8f19b4bc-f42f-4616-bbd0-8c488e7d0843 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:29.199327 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f19b4bc-f42f-4616-bbd0-8c488e7d0843 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:29.199819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f19b4bc-f42f-4616-bbd0-8c488e7d0843 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:29.200579 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f19b4bc-f42f-4616-bbd0-8c488e7d0843 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:29.201015 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f19b4bc-f42f-4616-bbd0-8c488e7d0843 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:29.325317 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8f19b4bc-f42f-4616-bbd0-8c488e7d0843 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:29.333369 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8f19b4bc-f42f-4616-bbd0-8c488e7d0843 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1676 microversion: 2.1 time: 0.146571 Jul 25 12:18:29.333932 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 264/518] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:29 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:29.458813 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a9431b95-0f85-4408-bd82-ab9c52437c72 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:29.460983 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a9431b95-0f85-4408-bd82-ab9c52437c72 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:29.467354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9431b95-0f85-4408-bd82-ab9c52437c72 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:29.467830 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9431b95-0f85-4408-bd82-ab9c52437c72 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:29.469236 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9431b95-0f85-4408-bd82-ab9c52437c72 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:29.469670 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a9431b95-0f85-4408-bd82-ab9c52437c72 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:29.497766 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a9431b95-0f85-4408-bd82-ab9c52437c72 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042989 Jul 25 12:18:29.498305 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 255/519] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:18:29 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:30.357506 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2d84d0d0-5e3a-4ddd-8329-401e3bb565c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:30.358153 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2d84d0d0-5e3a-4ddd-8329-401e3bb565c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:30.364720 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d84d0d0-5e3a-4ddd-8329-401e3bb565c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:30.365179 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d84d0d0-5e3a-4ddd-8329-401e3bb565c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:30.365939 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d84d0d0-5e3a-4ddd-8329-401e3bb565c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:30.366374 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d84d0d0-5e3a-4ddd-8329-401e3bb565c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:30.494365 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2d84d0d0-5e3a-4ddd-8329-401e3bb565c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:30.497851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:30.505466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2d84d0d0-5e3a-4ddd-8329-401e3bb565c6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1676 microversion: 2.1 time: 0.150943 Jul 25 12:18:30.515441 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 265/520] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:30 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:30.516165 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4367b694-32da-40f5-9230-f73f117a64a3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:30.516165 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4367b694-32da-40f5-9230-f73f117a64a3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:30.520173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4367b694-32da-40f5-9230-f73f117a64a3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:30.520643 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4367b694-32da-40f5-9230-f73f117a64a3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:30.521977 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4367b694-32da-40f5-9230-f73f117a64a3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:30.522417 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4367b694-32da-40f5-9230-f73f117a64a3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:30.554706 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4367b694-32da-40f5-9230-f73f117a64a3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048650 Jul 25 12:18:30.555262 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 256/521] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:18:30 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:18:31.201329 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-34089d01-3d02-4c43-b2d9-5d114bc34425 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:31.203683 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-34089d01-3d02-4c43-b2d9-5d114bc34425 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:31.210530 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34089d01-3d02-4c43-b2d9-5d114bc34425 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.210982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34089d01-3d02-4c43-b2d9-5d114bc34425 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.211797 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34089d01-3d02-4c43-b2d9-5d114bc34425 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.212235 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-34089d01-3d02-4c43-b2d9-5d114bc34425 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.235368 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-34089d01-3d02-4c43-b2d9-5d114bc34425 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lazy-loading 'flavor' on Instance uuid 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:18:31.357575 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-34089d01-3d02-4c43-b2d9-5d114bc34425 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "POST /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/action" status: 200 len: 32 microversion: 2.1 time: 0.160156 Jul 25 12:18:31.358267 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 266/522] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:18:31 2022] POST /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:18:31.368428 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-65b650db-04b7-4ba2-8aae-408e99c8dfe9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:31.369042 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-65b650db-04b7-4ba2-8aae-408e99c8dfe9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:31.375189 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-65b650db-04b7-4ba2-8aae-408e99c8dfe9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.375611 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-65b650db-04b7-4ba2-8aae-408e99c8dfe9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.376429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-65b650db-04b7-4ba2-8aae-408e99c8dfe9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.376864 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-65b650db-04b7-4ba2-8aae-408e99c8dfe9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.396038 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:31.528230 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5df29651-0be1-4284-b416-16658ae1f07a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:31.528934 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5df29651-0be1-4284-b416-16658ae1f07a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:31.535892 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5df29651-0be1-4284-b416-16658ae1f07a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.536342 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5df29651-0be1-4284-b416-16658ae1f07a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.537109 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5df29651-0be1-4284-b416-16658ae1f07a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.537541 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5df29651-0be1-4284-b416-16658ae1f07a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.595553 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-65b650db-04b7-4ba2-8aae-408e99c8dfe9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:31.604015 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-65b650db-04b7-4ba2-8aae-408e99c8dfe9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.239334 Jul 25 12:18:31.605110 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 257/523] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:31 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:31.610505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-93975aa4-1f2e-4487-ac37-64fac005012e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:31.612856 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-93975aa4-1f2e-4487-ac37-64fac005012e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:31.620767 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93975aa4-1f2e-4487-ac37-64fac005012e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.621274 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93975aa4-1f2e-4487-ac37-64fac005012e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.622338 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93975aa4-1f2e-4487-ac37-64fac005012e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.623214 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93975aa4-1f2e-4487-ac37-64fac005012e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.654229 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-93975aa4-1f2e-4487-ac37-64fac005012e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048137 Jul 25 12:18:31.654798 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 258/524] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:18:31 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:18:31.677847 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5df29651-0be1-4284-b416-16658ae1f07a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:31.686615 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5df29651-0be1-4284-b416-16658ae1f07a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1653 microversion: 2.1 time: 0.162870 Jul 25 12:18:31.687473 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 267/525] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:31 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1653 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:18:31.707801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6cb55970-c1fb-4dfd-9a80-b70955b7e918 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:31.713776 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6cb55970-c1fb-4dfd-9a80-b70955b7e918 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.714170 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6cb55970-c1fb-4dfd-9a80-b70955b7e918 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.726027 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0a5c1199-b8d6-40cb-9791-797d3d2dfe78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:31.726646 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0a5c1199-b8d6-40cb-9791-797d3d2dfe78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:31.733496 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a5c1199-b8d6-40cb-9791-797d3d2dfe78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.733968 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a5c1199-b8d6-40cb-9791-797d3d2dfe78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.734953 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a5c1199-b8d6-40cb-9791-797d3d2dfe78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.735419 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a5c1199-b8d6-40cb-9791-797d3d2dfe78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.739340 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6cb55970-c1fb-4dfd-9a80-b70955b7e918 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Going to try to start instance {{(pid=117776) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 12:18:31.765198 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0a5c1199-b8d6-40cb-9791-797d3d2dfe78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:18:31.794564 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6cb55970-c1fb-4dfd-9a80-b70955b7e918 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "POST /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/action" status: 202 len: 0 microversion: 2.1 time: 0.090962 Jul 25 12:18:31.795897 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 259/526] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:18:31 2022] POST /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:18:31.805349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e5647e3b-7be7-4ff6-9105-6afdc4f36801 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:31.806328 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e5647e3b-7be7-4ff6-9105-6afdc4f36801 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:31.813946 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5647e3b-7be7-4ff6-9105-6afdc4f36801 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.814397 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5647e3b-7be7-4ff6-9105-6afdc4f36801 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.815389 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5647e3b-7be7-4ff6-9105-6afdc4f36801 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.815875 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5647e3b-7be7-4ff6-9105-6afdc4f36801 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.866850 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0a5c1199-b8d6-40cb-9791-797d3d2dfe78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 204 len: 0 microversion: 2.1 time: 0.143724 Jul 25 12:18:31.867637 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 268/527] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:18:31 2022] DELETE /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:18:31.880489 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9c23c8c1-799e-474c-9ec5-6540fac18b11 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:31.881331 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9c23c8c1-799e-474c-9ec5-6540fac18b11 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:31.887339 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c23c8c1-799e-474c-9ec5-6540fac18b11 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.887909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c23c8c1-799e-474c-9ec5-6540fac18b11 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.888761 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c23c8c1-799e-474c-9ec5-6540fac18b11 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:31.889274 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c23c8c1-799e-474c-9ec5-6540fac18b11 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:31.991119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e5647e3b-7be7-4ff6-9105-6afdc4f36801 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:31.999012 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e5647e3b-7be7-4ff6-9105-6afdc4f36801 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1662 microversion: 2.1 time: 0.198173 Jul 25 12:18:32.000208 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 260/528] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:31 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1662 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:32.027429 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9c23c8c1-799e-474c-9ec5-6540fac18b11 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:32.035145 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9c23c8c1-799e-474c-9ec5-6540fac18b11 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1682 microversion: 2.1 time: 0.162323 Jul 25 12:18:32.035728 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 269/529] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:31 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:18:32.626074 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-93a432ba-3ad1-41d3-8148-552f6219c61b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:32.626683 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-93a432ba-3ad1-41d3-8148-552f6219c61b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:32.633155 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93a432ba-3ad1-41d3-8148-552f6219c61b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:32.633601 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93a432ba-3ad1-41d3-8148-552f6219c61b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:32.634349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93a432ba-3ad1-41d3-8148-552f6219c61b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:32.634776 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-93a432ba-3ad1-41d3-8148-552f6219c61b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:32.761082 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-93a432ba-3ad1-41d3-8148-552f6219c61b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:32.768999 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-93a432ba-3ad1-41d3-8148-552f6219c61b tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.147591 Jul 25 12:18:32.769563 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 261/530] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:32 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:33.020949 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0159ad31-9ad5-4948-af98-bace4b928491 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:33.021488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0159ad31-9ad5-4948-af98-bace4b928491 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:33.027994 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0159ad31-9ad5-4948-af98-bace4b928491 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:33.028445 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0159ad31-9ad5-4948-af98-bace4b928491 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:33.029204 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0159ad31-9ad5-4948-af98-bace4b928491 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:33.029639 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0159ad31-9ad5-4948-af98-bace4b928491 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:33.056381 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-430e6db7-1c07-42b5-b772-d1846e53119a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:33.056986 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-430e6db7-1c07-42b5-b772-d1846e53119a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:33.063015 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-430e6db7-1c07-42b5-b772-d1846e53119a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:33.063462 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-430e6db7-1c07-42b5-b772-d1846e53119a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:33.064249 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-430e6db7-1c07-42b5-b772-d1846e53119a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:33.064677 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-430e6db7-1c07-42b5-b772-d1846e53119a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:33.159212 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0159ad31-9ad5-4948-af98-bace4b928491 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:33.166686 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0159ad31-9ad5-4948-af98-bace4b928491 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1662 microversion: 2.1 time: 0.149583 Jul 25 12:18:33.167250 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 270/531] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:33 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:33.195757 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-430e6db7-1c07-42b5-b772-d1846e53119a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:33.203564 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-430e6db7-1c07-42b5-b772-d1846e53119a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1682 microversion: 2.1 time: 0.150615 Jul 25 12:18:33.204154 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 262/532] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:33 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:18:33.791103 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-50dd7fca-67a4-4363-87ee-5ec56699dad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:33.791763 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-50dd7fca-67a4-4363-87ee-5ec56699dad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:33.797754 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50dd7fca-67a4-4363-87ee-5ec56699dad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:33.798200 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50dd7fca-67a4-4363-87ee-5ec56699dad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:33.798961 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50dd7fca-67a4-4363-87ee-5ec56699dad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:33.799387 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50dd7fca-67a4-4363-87ee-5ec56699dad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:33.928482 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-50dd7fca-67a4-4363-87ee-5ec56699dad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:33.936449 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-50dd7fca-67a4-4363-87ee-5ec56699dad2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.149127 Jul 25 12:18:33.937015 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 271/533] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:33 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:34.186911 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f0b97a52-962a-493d-a817-0b6a36a91d25 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:34.188060 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f0b97a52-962a-493d-a817-0b6a36a91d25 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:34.194462 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0b97a52-962a-493d-a817-0b6a36a91d25 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:34.194898 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0b97a52-962a-493d-a817-0b6a36a91d25 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:34.195696 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0b97a52-962a-493d-a817-0b6a36a91d25 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:34.196134 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f0b97a52-962a-493d-a817-0b6a36a91d25 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:34.224546 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f0f747ee-f6e6-4429-bec1-2faa96c97f22 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:34.231993 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f0f747ee-f6e6-4429-bec1-2faa96c97f22 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:34.240873 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f0f747ee-f6e6-4429-bec1-2faa96c97f22 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:34.241430 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f0f747ee-f6e6-4429-bec1-2faa96c97f22 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:34.242197 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f0f747ee-f6e6-4429-bec1-2faa96c97f22 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:34.242629 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f0f747ee-f6e6-4429-bec1-2faa96c97f22 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:34.386088 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-f0f747ee-f6e6-4429-bec1-2faa96c97f22 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:34.393830 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f0f747ee-f6e6-4429-bec1-2faa96c97f22 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1682 microversion: 2.1 time: 0.173040 Jul 25 12:18:34.394492 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 272/534] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:34 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:34.510947 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f0b97a52-962a-493d-a817-0b6a36a91d25 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:34.518651 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f0b97a52-962a-493d-a817-0b6a36a91d25 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1662 microversion: 2.1 time: 0.335595 Jul 25 12:18:34.519309 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 263/535] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:34 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1662 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:34.958756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ab756a74-53c8-4b6c-9c3c-4025c173afb8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:34.959362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ab756a74-53c8-4b6c-9c3c-4025c173afb8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:34.965315 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab756a74-53c8-4b6c-9c3c-4025c173afb8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:34.965760 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab756a74-53c8-4b6c-9c3c-4025c173afb8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:34.966514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab756a74-53c8-4b6c-9c3c-4025c173afb8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:34.966947 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab756a74-53c8-4b6c-9c3c-4025c173afb8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:35.044677 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-4e217caa-90eb-4fd1-bb50-37ab9b421702 req-70fd96fc-5d99-43ea-be95-71bd8b26d000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d50aae7-fb06-467c-9a21-1d683297bc9e", "name": "network-vif-deleted", "tag": "59a6c2e2-7638-469a-bca1-c81f367ece3f"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:35.054704 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-4e217caa-90eb-4fd1-bb50-37ab9b421702 req-70fd96fc-5d99-43ea-be95-71bd8b26d000 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:35.055227 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-4e217caa-90eb-4fd1-bb50-37ab9b421702 req-70fd96fc-5d99-43ea-be95-71bd8b26d000 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:35.067574 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-4e217caa-90eb-4fd1-bb50-37ab9b421702 req-70fd96fc-5d99-43ea-be95-71bd8b26d000 service nova] Creating event network-vif-deleted:59a6c2e2-7638-469a-bca1-c81f367ece3f for instance 3d50aae7-fb06-467c-9a21-1d683297bc9e on hv-cinder-79760 Jul 25 12:18:35.072930 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-4e217caa-90eb-4fd1-bb50-37ab9b421702 req-70fd96fc-5d99-43ea-be95-71bd8b26d000 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033874 Jul 25 12:18:35.073829 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 264/536] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:18:35.109114 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ab756a74-53c8-4b6c-9c3c-4025c173afb8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:35.117265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ab756a74-53c8-4b6c-9c3c-4025c173afb8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.162327 Jul 25 12:18:35.117995 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 273/537] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:34 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:35.416650 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-86bd9f74-5af9-4144-bbed-546944ca4c66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:35.417348 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-86bd9f74-5af9-4144-bbed-546944ca4c66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:35.424514 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86bd9f74-5af9-4144-bbed-546944ca4c66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:35.424957 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86bd9f74-5af9-4144-bbed-546944ca4c66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:35.425713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86bd9f74-5af9-4144-bbed-546944ca4c66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:35.426144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86bd9f74-5af9-4144-bbed-546944ca4c66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:35.489143 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-86bd9f74-5af9-4144-bbed-546944ca4c66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:35.496600 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-86bd9f74-5af9-4144-bbed-546944ca4c66 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 200 len: 1615 microversion: 2.1 time: 0.084167 Jul 25 12:18:35.497168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 265/538] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:35 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 1615 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:35.540569 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0e94f9c5-5fee-47b2-a906-4d61efbd90a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:35.541182 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0e94f9c5-5fee-47b2-a906-4d61efbd90a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:35.548178 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e94f9c5-5fee-47b2-a906-4d61efbd90a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:35.548626 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e94f9c5-5fee-47b2-a906-4d61efbd90a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:35.549394 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e94f9c5-5fee-47b2-a906-4d61efbd90a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:35.549890 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0e94f9c5-5fee-47b2-a906-4d61efbd90a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:35.703953 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0e94f9c5-5fee-47b2-a906-4d61efbd90a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:35.711889 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0e94f9c5-5fee-47b2-a906-4d61efbd90a5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1662 microversion: 2.1 time: 0.175256 Jul 25 12:18:35.712469 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 274/539] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:35 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1662 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:36.138777 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c947a523-77a8-44c8-9de7-d6fc1504388f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:36.139303 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c947a523-77a8-44c8-9de7-d6fc1504388f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:36.146234 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c947a523-77a8-44c8-9de7-d6fc1504388f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:36.146680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c947a523-77a8-44c8-9de7-d6fc1504388f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:36.147443 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c947a523-77a8-44c8-9de7-d6fc1504388f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:36.147920 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c947a523-77a8-44c8-9de7-d6fc1504388f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:36.288418 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c947a523-77a8-44c8-9de7-d6fc1504388f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:36.296437 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c947a523-77a8-44c8-9de7-d6fc1504388f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.161685 Jul 25 12:18:36.297003 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 266/540] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:36 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:36.518411 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7ceee748-dc9f-40eb-b096-b5ee69af304d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:36.518931 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7ceee748-dc9f-40eb-b096-b5ee69af304d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:36.524966 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7ceee748-dc9f-40eb-b096-b5ee69af304d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:36.525404 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7ceee748-dc9f-40eb-b096-b5ee69af304d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:36.526146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7ceee748-dc9f-40eb-b096-b5ee69af304d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:36.526574 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7ceee748-dc9f-40eb-b096-b5ee69af304d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:36.539688 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-7ceee748-dc9f-40eb-b096-b5ee69af304d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7ceee748-dc9f-40eb-b096-b5ee69af304d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e HTTP/1.1 Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:18:36.541310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:18:36.543222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:18:36.543222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:18:36.543222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:18:36.543222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:18:36.543222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:18:36.543222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:18:36.543222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:18:36.543222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:18:36.543222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:18:36.543222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:18:36.543222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:18:36.543222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '3d50aae7-fb06-467c-9a21-1d683297bc9e'} Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:18:36.544063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:18:36.545215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:36.546255 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7ceee748-dc9f-40eb-b096-b5ee69af304d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 404 to user: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:18:36.546255 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7ceee748-dc9f-40eb-b096-b5ee69af304d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 404 len: 111 microversion: 2.1 time: 0.028871 Jul 25 12:18:36.546255 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 275/541] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:36 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:18:36.551424 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-66636a08-c27c-4f84-9c3e-a976bd7b260e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '.version_select at 0x7f942c294a60>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:36.569900 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-66636a08-c27c-4f84-9c3e-a976bd7b260e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024233254" status: 202 len: 0 microversion: 2.1 time: 0.022247 Jul 25 12:18:36.570441 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 267/542] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Jul 25 12:18:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024233254 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:18:36.733369 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2b4be073-ad66-4200-ba7b-464e97273787 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:36.733990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2b4be073-ad66-4200-ba7b-464e97273787 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:36.741989 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b4be073-ad66-4200-ba7b-464e97273787 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:36.742520 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b4be073-ad66-4200-ba7b-464e97273787 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:36.743196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b4be073-ad66-4200-ba7b-464e97273787 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:36.743661 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b4be073-ad66-4200-ba7b-464e97273787 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:36.982449 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2b4be073-ad66-4200-ba7b-464e97273787 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:36.990390 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2b4be073-ad66-4200-ba7b-464e97273787 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1666 microversion: 2.1 time: 0.260898 Jul 25 12:18:36.990949 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 276/543] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:36 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1666 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:37.265482 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-334f0594-f231-42da-98a7-b027d64e402d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Action: 'create', calling method: .version_select at 0x7f942c243940>, body: {"keypair": {"name": "tempest-keypair-1393590036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEalK1OtK//naP7XcUd6hXv2B0ywCYWRmZpUxti1/3PaUM3DeBpusAjF3Ms/DsPhbFgW5BHV1HqpmVKkGGvxWUIlpzWdt6JL80BFPhjRvFv1ug0sT4W6SS1sDwYAkj4Sg=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:37.282412 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-334f0594-f231-42da-98a7-b027d64e402d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:18:37.286267 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-334f0594-f231-42da-98a7-b027d64e402d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for user 3848eae5b8df48eb9816ba0d7485f7c0 and project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:18:37.307851 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-334f0594-f231-42da-98a7-b027d64e402d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046262 Jul 25 12:18:37.308436 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 268/544] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Jul 25 12:18:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:37.317426 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d6aa9818-f5fb-40d3-8df9-a1c6aa0800d8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:37.318022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d6aa9818-f5fb-40d3-8df9-a1c6aa0800d8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:37.324007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d6aa9818-f5fb-40d3-8df9-a1c6aa0800d8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:37.324451 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d6aa9818-f5fb-40d3-8df9-a1c6aa0800d8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:37.325204 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d6aa9818-f5fb-40d3-8df9-a1c6aa0800d8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:37.325631 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d6aa9818-f5fb-40d3-8df9-a1c6aa0800d8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:37.516755 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d6aa9818-f5fb-40d3-8df9-a1c6aa0800d8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:37.525825 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d6aa9818-f5fb-40d3-8df9-a1c6aa0800d8 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.212179 Jul 25 12:18:37.526400 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 277/545] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:37 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:38.549038 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-926e2c2e-1b76-4937-b2eb-8d9c06ada500 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:38.549653 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-926e2c2e-1b76-4937-b2eb-8d9c06ada500 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:38.556345 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-926e2c2e-1b76-4937-b2eb-8d9c06ada500 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:38.556796 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-926e2c2e-1b76-4937-b2eb-8d9c06ada500 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:38.557867 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-926e2c2e-1b76-4937-b2eb-8d9c06ada500 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:38.558183 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-926e2c2e-1b76-4937-b2eb-8d9c06ada500 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:38.677970 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1632491036", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6bc64d3-b55c-4e64-a050-b439cd834684"}], "security_groups": [{"name": "tempest-securitygroup--642752507"}], "key_name": "tempest-keypair-1393590036", "user_data": "}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:38.696386 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-926e2c2e-1b76-4937-b2eb-8d9c06ada500 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:38.704507 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-926e2c2e-1b76-4937-b2eb-8d9c06ada500 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.159728 Jul 25 12:18:38.705073 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 269/546] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:38 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:38.779835 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] validate_networks() for [('b6bc64d3-b55c-4e64-a050-b439cd834684', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:18:39.142497 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:18:39.142916 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:18:39.143385 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:18:39.143818 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:18:39.144227 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:18:39.153281 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:39.153725 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:39.154520 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:39.155201 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:39.172041 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:18:39.175956 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for user 3848eae5b8df48eb9816ba0d7485f7c0 and project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:18:39.186729 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:18:39.188959 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:18:39.196422 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-54db1caf-d9f8-4cd4-b62a-9340d90bbce7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-960971857"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:39.196999 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-54db1caf-d9f8-4cd4-b62a-9340d90bbce7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:39.203537 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54db1caf-d9f8-4cd4-b62a-9340d90bbce7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:39.204000 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54db1caf-d9f8-4cd4-b62a-9340d90bbce7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:39.204750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54db1caf-d9f8-4cd4-b62a-9340d90bbce7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:39.205176 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54db1caf-d9f8-4cd4-b62a-9340d90bbce7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:39.234882 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bef3cf25-5b39-49c8-9759-fb2cc2909eba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.561081 Jul 25 12:18:39.235729 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 278/547] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:18:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 12:18:39.246721 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fe8c701d-5571-4047-8122-ea2bc44c2929 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:39.247342 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fe8c701d-5571-4047-8122-ea2bc44c2929 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:39.308136 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fe8c701d-5571-4047-8122-ea2bc44c2929 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:39.315698 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fe8c701d-5571-4047-8122-ea2bc44c2929 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1242 microversion: 2.1 time: 0.072858 Jul 25 12:18:39.316515 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 279/548] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:39 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:39.374914 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.network.security_group_api [None req-54db1caf-d9f8-4cd4-b62a-9340d90bbce7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Removing security group 2d457c22-8406-4866-9e2a-22b419b5987b from port 18e2de81-a509-4850-99c1-f87dfe2e51c2 Jul 25 12:18:39.726012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-115cb43e-39e5-488c-a429-77fdd717cade tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:39.727370 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-115cb43e-39e5-488c-a429-77fdd717cade tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:39.737278 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-54db1caf-d9f8-4cd4-b62a-9340d90bbce7 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "POST /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/action" status: 202 len: 0 microversion: 2.1 time: 0.544650 Jul 25 12:18:39.739077 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 270/549] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:18:39 2022] POST /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:18:39.754793 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-764f84d8-e2e4-4ac1-86ff-29dbab4d61a6 req-4a21793c-5b93-4711-9b05-f06cdd3c4d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6facc5-40af-42cb-80fe-268e5a380a6b", "tag": "18e2de81-a509-4850-99c1-f87dfe2e51c2"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:39.767944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-115cb43e-39e5-488c-a429-77fdd717cade tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:39.768690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-115cb43e-39e5-488c-a429-77fdd717cade tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:39.773591 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-115cb43e-39e5-488c-a429-77fdd717cade tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:39.774130 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-115cb43e-39e5-488c-a429-77fdd717cade tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:39.787223 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-764f84d8-e2e4-4ac1-86ff-29dbab4d61a6 req-4a21793c-5b93-4711-9b05-f06cdd3c4d35 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:39.802277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-764f84d8-e2e4-4ac1-86ff-29dbab4d61a6 req-4a21793c-5b93-4711-9b05-f06cdd3c4d35 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:39.839356 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-764f84d8-e2e4-4ac1-86ff-29dbab4d61a6 req-4a21793c-5b93-4711-9b05-f06cdd3c4d35 service nova] Creating event network-changed:18e2de81-a509-4850-99c1-f87dfe2e51c2 for instance 5d6facc5-40af-42cb-80fe-268e5a380a6b on hv-cinder-79760 Jul 25 12:18:39.846316 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-764f84d8-e2e4-4ac1-86ff-29dbab4d61a6 req-4a21793c-5b93-4711-9b05-f06cdd3c4d35 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094576 Jul 25 12:18:39.848149 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 271/550] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:18:40.062801 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-115cb43e-39e5-488c-a429-77fdd717cade tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:40.076113 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-115cb43e-39e5-488c-a429-77fdd717cade tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.352068 Jul 25 12:18:40.079529 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 280/551] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:39 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:40.338856 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-802a06a6-1a82-4a37-85c0-768a0e2ff831 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:40.339717 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-802a06a6-1a82-4a37-85c0-768a0e2ff831 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:40.346295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-802a06a6-1a82-4a37-85c0-768a0e2ff831 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:40.346740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-802a06a6-1a82-4a37-85c0-768a0e2ff831 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:40.347497 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-802a06a6-1a82-4a37-85c0-768a0e2ff831 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:40.347974 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-802a06a6-1a82-4a37-85c0-768a0e2ff831 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:40.499206 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-802a06a6-1a82-4a37-85c0-768a0e2ff831 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:40.507808 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-802a06a6-1a82-4a37-85c0-768a0e2ff831 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1294 microversion: 2.1 time: 0.173073 Jul 25 12:18:40.522718 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 272/552] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:40 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1294 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:41.099690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ee45e856-7e6d-4a85-8f7e-e9c89bbfdc2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:41.100307 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ee45e856-7e6d-4a85-8f7e-e9c89bbfdc2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:41.106692 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee45e856-7e6d-4a85-8f7e-e9c89bbfdc2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:41.107138 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee45e856-7e6d-4a85-8f7e-e9c89bbfdc2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:41.107921 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee45e856-7e6d-4a85-8f7e-e9c89bbfdc2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:41.108349 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ee45e856-7e6d-4a85-8f7e-e9c89bbfdc2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:41.112399 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:41.250815 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ee45e856-7e6d-4a85-8f7e-e9c89bbfdc2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:41.258759 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ee45e856-7e6d-4a85-8f7e-e9c89bbfdc2d tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.163007 Jul 25 12:18:41.259324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 281/553] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:41 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:41.530259 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-eafedd2e-0973-4191-8a68-df0d52df82e3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:41.530952 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-eafedd2e-0973-4191-8a68-df0d52df82e3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:41.537386 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eafedd2e-0973-4191-8a68-df0d52df82e3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:41.537819 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eafedd2e-0973-4191-8a68-df0d52df82e3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:41.538576 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eafedd2e-0973-4191-8a68-df0d52df82e3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:41.539006 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eafedd2e-0973-4191-8a68-df0d52df82e3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:41.667262 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eafedd2e-0973-4191-8a68-df0d52df82e3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:41.675203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-eafedd2e-0973-4191-8a68-df0d52df82e3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1300 microversion: 2.1 time: 0.149085 Jul 25 12:18:41.675796 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 273/554] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:41 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1300 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:41.965360 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-886f992b-6fdd-4c6a-b870-d181ed900c3d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:41.965998 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-886f992b-6fdd-4c6a-b870-d181ed900c3d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:41.977012 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-bbb43a97-bd09-4b31-8d4d-e3c39d756f60 req-2f3d2629-d86b-4c12-bfa6-df6276431e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6facc5-40af-42cb-80fe-268e5a380a6b", "tag": "18e2de81-a509-4850-99c1-f87dfe2e51c2"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:41.984450 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-886f992b-6fdd-4c6a-b870-d181ed900c3d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:41.984893 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-886f992b-6fdd-4c6a-b870-d181ed900c3d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:41.985679 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-886f992b-6fdd-4c6a-b870-d181ed900c3d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:41.989534 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-bbb43a97-bd09-4b31-8d4d-e3c39d756f60 req-2f3d2629-d86b-4c12-bfa6-df6276431e77 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:41.989969 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-bbb43a97-bd09-4b31-8d4d-e3c39d756f60 req-2f3d2629-d86b-4c12-bfa6-df6276431e77 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:41.993999 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-886f992b-6fdd-4c6a-b870-d181ed900c3d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:42.005965 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-bbb43a97-bd09-4b31-8d4d-e3c39d756f60 req-2f3d2629-d86b-4c12-bfa6-df6276431e77 service nova] Creating event network-changed:18e2de81-a509-4850-99c1-f87dfe2e51c2 for instance 5d6facc5-40af-42cb-80fe-268e5a380a6b on hv-cinder-79760 Jul 25 12:18:42.010884 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-bbb43a97-bd09-4b31-8d4d-e3c39d756f60 req-2f3d2629-d86b-4c12-bfa6-df6276431e77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037452 Jul 25 12:18:42.011844 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 274/555] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:42.070514 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8e925393-598a-46e8-9ec9-b61b67a23ece tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:42.071384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8e925393-598a-46e8-9ec9-b61b67a23ece tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:42.080352 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e925393-598a-46e8-9ec9-b61b67a23ece tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:42.080811 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e925393-598a-46e8-9ec9-b61b67a23ece tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:42.083927 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e925393-598a-46e8-9ec9-b61b67a23ece tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:42.084181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8e925393-598a-46e8-9ec9-b61b67a23ece tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:42.087809 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-886f992b-6fdd-4c6a-b870-d181ed900c3d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lazy-loading 'services' on Instance uuid 5d6facc5-40af-42cb-80fe-268e5a380a6b {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:18:42.127113 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8e925393-598a-46e8-9ec9-b61b67a23ece tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-volume_attachments/1f17d095-3065-46cd-be41-90ce82ddc011" status: 200 len: 194 microversion: 2.20 time: 0.064314 Jul 25 12:18:42.135407 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 275/556] 10.222.0.42 () {60 vars in 1454 bytes} [Mon Jul 25 12:18:42 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-volume_attachments/1f17d095-3065-46cd-be41-90ce82ddc011 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:18:42.185366 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-886f992b-6fdd-4c6a-b870-d181ed900c3d tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/os-volume_attachments/04be480f-0e31-43a2-a203-6bdf76350cd3" status: 202 len: 0 microversion: 2.1 time: 0.223158 Jul 25 12:18:42.202660 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 282/557] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Jul 25 12:18:41 2022] DELETE /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/os-volume_attachments/04be480f-0e31-43a2-a203-6bdf76350cd3 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:18:42.207287 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fab8fc0f-dd09-4647-8ce9-5ead25eb36e1 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:42.210364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fab8fc0f-dd09-4647-8ce9-5ead25eb36e1 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:42.232408 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fab8fc0f-dd09-4647-8ce9-5ead25eb36e1 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:42.232862 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fab8fc0f-dd09-4647-8ce9-5ead25eb36e1 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:42.233583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9f798ced-ffeb-4a51-8db2-57d71174c6fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:42.234599 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9f798ced-ffeb-4a51-8db2-57d71174c6fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:42.235263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fab8fc0f-dd09-4647-8ce9-5ead25eb36e1 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:42.237195 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fab8fc0f-dd09-4647-8ce9-5ead25eb36e1 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:42.248599 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f798ced-ffeb-4a51-8db2-57d71174c6fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:42.249095 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f798ced-ffeb-4a51-8db2-57d71174c6fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:42.254469 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f798ced-ffeb-4a51-8db2-57d71174c6fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:42.256482 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9f798ced-ffeb-4a51-8db2-57d71174c6fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:42.310709 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fab8fc0f-dd09-4647-8ce9-5ead25eb36e1 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119123 Jul 25 12:18:42.315867 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 276/558] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:18:42 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:42.321360 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-dea207c2-8b41-495b-8631-cb8941629450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:42.322276 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-dea207c2-8b41-495b-8631-cb8941629450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:42.329741 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dea207c2-8b41-495b-8631-cb8941629450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:42.330532 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dea207c2-8b41-495b-8631-cb8941629450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:42.332208 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dea207c2-8b41-495b-8631-cb8941629450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:42.333660 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-dea207c2-8b41-495b-8631-cb8941629450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:42.374831 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:42.409240 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-9f798ced-ffeb-4a51-8db2-57d71174c6fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lazy-loading 'services' on Instance uuid 66654721-31e2-48d8-a0ea-c146d277ab47 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:18:42.499530 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9f798ced-ffeb-4a51-8db2-57d71174c6fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "DELETE /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-volume_attachments/1f17d095-3065-46cd-be41-90ce82ddc011" status: 202 len: 0 microversion: 2.20 time: 0.282274 Jul 25 12:18:42.500731 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 283/559] 10.222.0.42 () {60 vars in 1457 bytes} [Mon Jul 25 12:18:42 2022] DELETE /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-volume_attachments/1f17d095-3065-46cd-be41-90ce82ddc011 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:18:42.511230 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-18efb1a1-711d-42e5-a5f5-74047436f090 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:42.515480 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-18efb1a1-711d-42e5-a5f5-74047436f090 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:42.522338 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18efb1a1-711d-42e5-a5f5-74047436f090 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:42.522826 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18efb1a1-711d-42e5-a5f5-74047436f090 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:42.523631 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18efb1a1-711d-42e5-a5f5-74047436f090 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:42.525109 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-18efb1a1-711d-42e5-a5f5-74047436f090 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:42.526667 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-dea207c2-8b41-495b-8631-cb8941629450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:42.535871 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-dea207c2-8b41-495b-8631-cb8941629450 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.218541 Jul 25 12:18:42.536528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 277/560] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:42 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:42.559785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-18efb1a1-711d-42e5-a5f5-74047436f090 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054092 Jul 25 12:18:42.560376 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 284/561] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Jul 25 12:18:42 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:18:42.705703 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0787ce9f-970f-423c-9a0d-dcb700611dea tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:42.706468 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0787ce9f-970f-423c-9a0d-dcb700611dea tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:42.723619 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0787ce9f-970f-423c-9a0d-dcb700611dea tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:42.724635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0787ce9f-970f-423c-9a0d-dcb700611dea tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:42.725423 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0787ce9f-970f-423c-9a0d-dcb700611dea tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:42.726600 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0787ce9f-970f-423c-9a0d-dcb700611dea tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:43.085677 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0787ce9f-970f-423c-9a0d-dcb700611dea tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:43.094426 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0787ce9f-970f-423c-9a0d-dcb700611dea tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1367 microversion: 2.1 time: 0.400968 Jul 25 12:18:43.095398 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 278/562] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:42 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:43.325536 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9232b79b-ba6a-49a3-ae1c-b59f8e6941d8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:43.328277 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9232b79b-ba6a-49a3-ae1c-b59f8e6941d8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:43.331997 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:43.336862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9232b79b-ba6a-49a3-ae1c-b59f8e6941d8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:43.337673 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9232b79b-ba6a-49a3-ae1c-b59f8e6941d8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:43.338576 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9232b79b-ba6a-49a3-ae1c-b59f8e6941d8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:43.339092 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9232b79b-ba6a-49a3-ae1c-b59f8e6941d8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:43.377273 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9232b79b-ba6a-49a3-ae1c-b59f8e6941d8 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057028 Jul 25 12:18:43.378332 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 285/563] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:18:43 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:18:43.393334 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a6972c74-8820-49be-af30-32d8d3d33b30 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:43.393847 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a6972c74-8820-49be-af30-32d8d3d33b30 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:43.403934 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6972c74-8820-49be-af30-32d8d3d33b30 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:43.404389 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6972c74-8820-49be-af30-32d8d3d33b30 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:43.405929 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6972c74-8820-49be-af30-32d8d3d33b30 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:43.406357 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a6972c74-8820-49be-af30-32d8d3d33b30 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:43.492854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-a6972c74-8820-49be-af30-32d8d3d33b30 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] HTTP exception thrown: Instance 5d6facc5-40af-42cb-80fe-268e5a380a6b is not attached to volume 04be480f-0e31-43a2-a203-6bdf76350cd3 Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a6972c74-8820-49be-af30-32d8d3d33b30 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Request method failure captured: Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/os-volume_attachments/04be480f-0e31-43a2-a203-6bdf76350cd3 HTTP/1.1 Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3ol0KUl9hLuGU2QmCTnKaYc4YL9Mt-H-IGGrw0A0Ijqat4bPjphRFh3o-BV1BKmjCJ1JjUy1ITrEix9JHJM8pz_LEjdaCVpk8JPgEUEiFeLxNAx3EW1xMxL9CFJa9lVMAFlIDxEZwfE9igBTJcQ8GKQmH0kz842mwKxOmkBdY7TYU1o Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: f63781e2ea3b43b48fc5a065fea7bad4 Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-TestMinimumBasicScenario-734729338 Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:18:43.495256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:18:43.496595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f63781e2ea3b43b48fc5a065fea7bad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f63781e2ea3b43b48fc5a065fea7bad4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f63781e2ea3b43b48fc5a065fea7bad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f63781e2ea3b43b48fc5a065fea7bad4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:18:43.496595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-TestMinimumBasicScenario-734729338 Jul 25 12:18:43.496595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: f63781e2ea3b43b48fc5a065fea7bad4 Jul 25 12:18:43.496595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-TestMinimumBasicScenario-734729338 Jul 25 12:18:43.496595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-TestMinimumBasicScenario-734729338-project Jul 25 12:18:43.496595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:18:43.496595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:18:43.496595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 5ea6250801fc4f74b2180533687e8cf2 Jul 25 12:18:43.496595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-TestMinimumBasicScenario-734729338-project Jul 25 12:18:43.496595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:18:43.496595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance 5d6facc5-40af-42cb-80fe-268e5a380a6b is not attached to volume 04be480f-0e31-43a2-a203-6bdf76350cd3 Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'server_id': '5d6facc5-40af-42cb-80fe-268e5a380a6b', 'id': '04be480f-0e31-43a2-a203-6bdf76350cd3'} Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 04be480f-0e31-43a2-a203-6bdf76350cd3. Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:18:43.497256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6facc5-40af-42cb-80fe-268e5a380a6b is not attached to volume 04be480f-0e31-43a2-a203-6bdf76350cd3 Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6facc5-40af-42cb-80fe-268e5a380a6b is not attached to volume 04be480f-0e31-43a2-a203-6bdf76350cd3 Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:43.498317 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a6972c74-8820-49be-af30-32d8d3d33b30 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Returning 404 to user: Instance 5d6facc5-40af-42cb-80fe-268e5a380a6b is not attached to volume 04be480f-0e31-43a2-a203-6bdf76350cd3 {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:18:43.499355 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a6972c74-8820-49be-af30-32d8d3d33b30 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/os-volume_attachments/04be480f-0e31-43a2-a203-6bdf76350cd3" status: 404 len: 154 microversion: 2.1 time: 0.108206 Jul 25 12:18:43.499355 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 279/564] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Jul 25 12:18:43 2022] DELETE /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b/os-volume_attachments/04be480f-0e31-43a2-a203-6bdf76350cd3 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:18:43.558757 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a6c161af-9953-4d8c-9a9f-1359a98e935e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:43.559511 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a6c161af-9953-4d8c-9a9f-1359a98e935e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:43.567805 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a6c161af-9953-4d8c-9a9f-1359a98e935e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:43.567805 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a6c161af-9953-4d8c-9a9f-1359a98e935e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:43.569002 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a6c161af-9953-4d8c-9a9f-1359a98e935e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:43.569669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a6c161af-9953-4d8c-9a9f-1359a98e935e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:43.573817 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-60554a98-0951-49d3-aaff-e6b5ec94f20a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:43.576378 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-60554a98-0951-49d3-aaff-e6b5ec94f20a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:43.586144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-60554a98-0951-49d3-aaff-e6b5ec94f20a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:43.586809 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-60554a98-0951-49d3-aaff-e6b5ec94f20a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:43.588971 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-60554a98-0951-49d3-aaff-e6b5ec94f20a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:43.591977 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-60554a98-0951-49d3-aaff-e6b5ec94f20a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:43.640858 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-60554a98-0951-49d3-aaff-e6b5ec94f20a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066362 Jul 25 12:18:43.645026 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 280/565] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Jul 25 12:18:43 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:18:43.750223 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a6c161af-9953-4d8c-9a9f-1359a98e935e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:43.761055 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a6c161af-9953-4d8c-9a9f-1359a98e935e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.205558 Jul 25 12:18:43.762257 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 286/566] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:43 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:44.050618 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-e4f10d61-ff51-4d86-a984-b5e42768cc7d req-a6130625-3c92-42a2-b5a4-77731e52d1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf2bada-8518-4f83-8d6b-abe45ffe638f", "tag": "77667b73-2775-4d94-a310-daa16b6ca4d0"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:44.060065 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-e4f10d61-ff51-4d86-a984-b5e42768cc7d req-a6130625-3c92-42a2-b5a4-77731e52d1d7 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:44.060501 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-e4f10d61-ff51-4d86-a984-b5e42768cc7d req-a6130625-3c92-42a2-b5a4-77731e52d1d7 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:44.071475 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-e4f10d61-ff51-4d86-a984-b5e42768cc7d req-a6130625-3c92-42a2-b5a4-77731e52d1d7 service nova] Creating event network-changed:77667b73-2775-4d94-a310-daa16b6ca4d0 for instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f on hv-cinder-79760 Jul 25 12:18:44.076264 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-e4f10d61-ff51-4d86-a984-b5e42768cc7d req-a6130625-3c92-42a2-b5a4-77731e52d1d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029259 Jul 25 12:18:44.076847 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 281/567] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:44.114558 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fb2fca0d-e763-4e59-a5d5-2431b345d66e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:44.115162 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fb2fca0d-e763-4e59-a5d5-2431b345d66e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:44.121356 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb2fca0d-e763-4e59-a5d5-2431b345d66e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:44.121804 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb2fca0d-e763-4e59-a5d5-2431b345d66e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:44.122560 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb2fca0d-e763-4e59-a5d5-2431b345d66e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:44.122995 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb2fca0d-e763-4e59-a5d5-2431b345d66e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:44.257098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fb2fca0d-e763-4e59-a5d5-2431b345d66e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:44.265337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fb2fca0d-e763-4e59-a5d5-2431b345d66e tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1367 microversion: 2.1 time: 0.153999 Jul 25 12:18:44.265905 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 287/568] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:44 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:44.658368 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3cb8f989-8c9b-46c9-a629-36f97b925772 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:44.660639 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3cb8f989-8c9b-46c9-a629-36f97b925772 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:44.666735 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3cb8f989-8c9b-46c9-a629-36f97b925772 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:44.667176 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3cb8f989-8c9b-46c9-a629-36f97b925772 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:44.667959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3cb8f989-8c9b-46c9-a629-36f97b925772 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:44.668385 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3cb8f989-8c9b-46c9-a629-36f97b925772 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:44.696855 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3cb8f989-8c9b-46c9-a629-36f97b925772 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043594 Jul 25 12:18:44.697391 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 282/569] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Jul 25 12:18:44 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:44.757864 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d9beecc5-25fa-4472-bb21-939820aa2a84 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:44.758363 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d9beecc5-25fa-4472-bb21-939820aa2a84 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:44.764712 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d9beecc5-25fa-4472-bb21-939820aa2a84 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:44.765158 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d9beecc5-25fa-4472-bb21-939820aa2a84 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:44.765909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d9beecc5-25fa-4472-bb21-939820aa2a84 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:44.766337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d9beecc5-25fa-4472-bb21-939820aa2a84 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:44.786369 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bee78b3d-d758-4e3d-b15d-4cd46012a3d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:44.786972 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bee78b3d-d758-4e3d-b15d-4cd46012a3d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:44.791798 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d9beecc5-25fa-4472-bb21-939820aa2a84 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:18:44.792821 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bee78b3d-d758-4e3d-b15d-4cd46012a3d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:44.793296 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bee78b3d-d758-4e3d-b15d-4cd46012a3d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:44.794038 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bee78b3d-d758-4e3d-b15d-4cd46012a3d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:44.794458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bee78b3d-d758-4e3d-b15d-4cd46012a3d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:44.870196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d9beecc5-25fa-4472-bb21-939820aa2a84 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "DELETE /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 204 len: 0 microversion: 2.20 time: 0.115737 Jul 25 12:18:44.873812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 288/570] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Jul 25 12:18:44 2022] DELETE /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:18:44.879873 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-961d4d70-0987-4f61-879d-20cc135f5f46 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:44.880703 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-961d4d70-0987-4f61-879d-20cc135f5f46 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:44.886752 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-961d4d70-0987-4f61-879d-20cc135f5f46 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:44.887123 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-961d4d70-0987-4f61-879d-20cc135f5f46 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:44.887923 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-961d4d70-0987-4f61-879d-20cc135f5f46 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:44.888360 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-961d4d70-0987-4f61-879d-20cc135f5f46 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:44.939571 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bee78b3d-d758-4e3d-b15d-4cd46012a3d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:44.947677 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bee78b3d-d758-4e3d-b15d-4cd46012a3d1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.165020 Jul 25 12:18:44.948151 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 283/571] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:44 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:44.952546 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-03431233-56a3-415e-9f57-b583941c2208 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:44.953029 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-03431233-56a3-415e-9f57-b583941c2208 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:44.955809 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:44.960136 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03431233-56a3-415e-9f57-b583941c2208 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:44.960951 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03431233-56a3-415e-9f57-b583941c2208 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:44.962085 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03431233-56a3-415e-9f57-b583941c2208 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:44.962522 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-03431233-56a3-415e-9f57-b583941c2208 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:44.990397 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-03431233-56a3-415e-9f57-b583941c2208 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:18:45.018228 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-961d4d70-0987-4f61-879d-20cc135f5f46 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:45.026916 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-961d4d70-0987-4f61-879d-20cc135f5f46 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:45.028579 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-961d4d70-0987-4f61-879d-20cc135f5f46 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:45.030510 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-961d4d70-0987-4f61-879d-20cc135f5f46 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.154650 Jul 25 12:18:45.031141 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 289/572] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:18:44 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:18:45.068046 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-03431233-56a3-415e-9f57-b583941c2208 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 204 len: 0 microversion: 2.1 time: 0.118567 Jul 25 12:18:45.068953 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 284/573] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:18:44 2022] DELETE /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:18:45.077653 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1c3792b4-3876-49b9-b7e2-3e368feb15cc tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:45.078778 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1c3792b4-3876-49b9-b7e2-3e368feb15cc tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:45.087993 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c3792b4-3876-49b9-b7e2-3e368feb15cc tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:45.088535 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c3792b4-3876-49b9-b7e2-3e368feb15cc tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:45.089387 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c3792b4-3876-49b9-b7e2-3e368feb15cc tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:45.089900 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c3792b4-3876-49b9-b7e2-3e368feb15cc tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:45.221310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1c3792b4-3876-49b9-b7e2-3e368feb15cc tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:45.228953 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1c3792b4-3876-49b9-b7e2-3e368feb15cc tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1554 microversion: 2.1 time: 0.155772 Jul 25 12:18:45.229519 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 290/574] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:45 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:45.286916 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c61794f0-185c-4418-851f-4eb85cb4f252 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:45.287660 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c61794f0-185c-4418-851f-4eb85cb4f252 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:45.293637 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c61794f0-185c-4418-851f-4eb85cb4f252 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:45.294084 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c61794f0-185c-4418-851f-4eb85cb4f252 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:45.294844 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c61794f0-185c-4418-851f-4eb85cb4f252 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:45.295275 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c61794f0-185c-4418-851f-4eb85cb4f252 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:45.419481 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c61794f0-185c-4418-851f-4eb85cb4f252 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:45.426958 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c61794f0-185c-4418-851f-4eb85cb4f252 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1367 microversion: 2.1 time: 0.144310 Jul 25 12:18:45.427457 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 285/575] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:45 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:45.969110 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3959551e-acae-4cec-95d7-a0ad3d172b00 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:45.969757 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3959551e-acae-4cec-95d7-a0ad3d172b00 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:45.976315 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3959551e-acae-4cec-95d7-a0ad3d172b00 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:45.976765 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3959551e-acae-4cec-95d7-a0ad3d172b00 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:45.977521 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3959551e-acae-4cec-95d7-a0ad3d172b00 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:45.977958 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3959551e-acae-4cec-95d7-a0ad3d172b00 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:46.054365 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7e1c7b92-a4d0-4398-8916-01a3226713fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:46.054962 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7e1c7b92-a4d0-4398-8916-01a3226713fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:46.062037 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e1c7b92-a4d0-4398-8916-01a3226713fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:46.062501 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e1c7b92-a4d0-4398-8916-01a3226713fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:46.063233 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e1c7b92-a4d0-4398-8916-01a3226713fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:46.063679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7e1c7b92-a4d0-4398-8916-01a3226713fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:46.103890 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3959551e-acae-4cec-95d7-a0ad3d172b00 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:46.112415 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3959551e-acae-4cec-95d7-a0ad3d172b00 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.147180 Jul 25 12:18:46.112975 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 291/576] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:45 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:46.193354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7e1c7b92-a4d0-4398-8916-01a3226713fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:46.201087 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7e1c7b92-a4d0-4398-8916-01a3226713fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:46.202600 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7e1c7b92-a4d0-4398-8916-01a3226713fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:46.203767 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7e1c7b92-a4d0-4398-8916-01a3226713fa tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.153282 Jul 25 12:18:46.204312 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 286/577] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:18:46 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:18:46.250138 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-350695a9-4361-4dae-b074-ad058d66c09c tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:46.250821 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-350695a9-4361-4dae-b074-ad058d66c09c tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:46.257013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-350695a9-4361-4dae-b074-ad058d66c09c tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:46.257463 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-350695a9-4361-4dae-b074-ad058d66c09c tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:46.258222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-350695a9-4361-4dae-b074-ad058d66c09c tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:46.258657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-350695a9-4361-4dae-b074-ad058d66c09c tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:46.387350 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-350695a9-4361-4dae-b074-ad058d66c09c tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:46.395129 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-350695a9-4361-4dae-b074-ad058d66c09c tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1554 microversion: 2.1 time: 0.149516 Jul 25 12:18:46.395726 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 292/578] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:46 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:46.446644 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f59de772-8707-4f42-a24f-b286ea6f035a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:46.447281 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f59de772-8707-4f42-a24f-b286ea6f035a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:46.453430 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f59de772-8707-4f42-a24f-b286ea6f035a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:46.453873 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f59de772-8707-4f42-a24f-b286ea6f035a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:46.454622 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f59de772-8707-4f42-a24f-b286ea6f035a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:46.455048 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f59de772-8707-4f42-a24f-b286ea6f035a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:46.579557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f59de772-8707-4f42-a24f-b286ea6f035a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:46.586831 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f59de772-8707-4f42-a24f-b286ea6f035a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1367 microversion: 2.1 time: 0.143963 Jul 25 12:18:46.587326 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 287/579] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:46 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:47.134413 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-190f35a7-af35-456b-9d98-1901a5eeb350 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:47.135026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-190f35a7-af35-456b-9d98-1901a5eeb350 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:47.142109 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-190f35a7-af35-456b-9d98-1901a5eeb350 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:47.142561 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-190f35a7-af35-456b-9d98-1901a5eeb350 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:47.143323 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-190f35a7-af35-456b-9d98-1901a5eeb350 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:47.143786 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-190f35a7-af35-456b-9d98-1901a5eeb350 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:47.226801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9848d9fd-9ccb-4e91-822f-4c64786b0362 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:47.227399 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9848d9fd-9ccb-4e91-822f-4c64786b0362 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:47.233826 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9848d9fd-9ccb-4e91-822f-4c64786b0362 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:47.234264 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9848d9fd-9ccb-4e91-822f-4c64786b0362 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:47.235015 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9848d9fd-9ccb-4e91-822f-4c64786b0362 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:47.235443 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9848d9fd-9ccb-4e91-822f-4c64786b0362 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:47.271202 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-190f35a7-af35-456b-9d98-1901a5eeb350 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:47.280437 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-190f35a7-af35-456b-9d98-1901a5eeb350 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.150088 Jul 25 12:18:47.281012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 293/580] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:47 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:47.292956 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:47.364782 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9848d9fd-9ccb-4e91-822f-4c64786b0362 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:47.372537 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9848d9fd-9ccb-4e91-822f-4c64786b0362 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:47.374719 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9848d9fd-9ccb-4e91-822f-4c64786b0362 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:47.375908 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9848d9fd-9ccb-4e91-822f-4c64786b0362 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.152974 Jul 25 12:18:47.376461 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 288/581] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:18:47 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:18:47.417060 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2eab8f14-3ac9-4347-b708-1c60deafac36 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:47.417656 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2eab8f14-3ac9-4347-b708-1c60deafac36 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:47.424219 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2eab8f14-3ac9-4347-b708-1c60deafac36 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:47.424663 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2eab8f14-3ac9-4347-b708-1c60deafac36 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:47.425421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2eab8f14-3ac9-4347-b708-1c60deafac36 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:47.425849 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2eab8f14-3ac9-4347-b708-1c60deafac36 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:47.549705 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2eab8f14-3ac9-4347-b708-1c60deafac36 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:47.553154 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:47.557859 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2eab8f14-3ac9-4347-b708-1c60deafac36 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1554 microversion: 2.1 time: 0.144683 Jul 25 12:18:47.558418 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 294/582] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:47 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1554 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:47.607743 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1f35b96b-cec1-40f7-8b32-10071dc76bbc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:47.608918 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1f35b96b-cec1-40f7-8b32-10071dc76bbc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:47.614841 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f35b96b-cec1-40f7-8b32-10071dc76bbc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:47.615289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f35b96b-cec1-40f7-8b32-10071dc76bbc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:47.616125 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f35b96b-cec1-40f7-8b32-10071dc76bbc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:47.616556 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f35b96b-cec1-40f7-8b32-10071dc76bbc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:47.744973 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1f35b96b-cec1-40f7-8b32-10071dc76bbc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:47.752922 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1f35b96b-cec1-40f7-8b32-10071dc76bbc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1367 microversion: 2.1 time: 0.149086 Jul 25 12:18:47.753481 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 289/583] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:47 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:48.302528 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-24df2f1b-4692-4b69-9ef8-81924f0da0ae tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:48.303139 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-24df2f1b-4692-4b69-9ef8-81924f0da0ae tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:48.310926 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24df2f1b-4692-4b69-9ef8-81924f0da0ae tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:48.311377 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24df2f1b-4692-4b69-9ef8-81924f0da0ae tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:48.312177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24df2f1b-4692-4b69-9ef8-81924f0da0ae tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:48.312618 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24df2f1b-4692-4b69-9ef8-81924f0da0ae tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:48.398412 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-eaf9330e-31c3-400b-8cbb-4b07cf62dfa7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:48.399098 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-eaf9330e-31c3-400b-8cbb-4b07cf62dfa7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:48.406651 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eaf9330e-31c3-400b-8cbb-4b07cf62dfa7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:48.407100 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eaf9330e-31c3-400b-8cbb-4b07cf62dfa7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:48.408075 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eaf9330e-31c3-400b-8cbb-4b07cf62dfa7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:48.408651 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-eaf9330e-31c3-400b-8cbb-4b07cf62dfa7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:48.486358 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-24df2f1b-4692-4b69-9ef8-81924f0da0ae tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:48.494622 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-24df2f1b-4692-4b69-9ef8-81924f0da0ae tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.196845 Jul 25 12:18:48.495412 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 295/584] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:48 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:48.580019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b5234557-7dd9-49b9-b0a7-561224d08b82 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:48.580645 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b5234557-7dd9-49b9-b0a7-561224d08b82 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:48.596997 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5234557-7dd9-49b9-b0a7-561224d08b82 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:48.597463 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5234557-7dd9-49b9-b0a7-561224d08b82 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:48.598368 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5234557-7dd9-49b9-b0a7-561224d08b82 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:48.599047 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b5234557-7dd9-49b9-b0a7-561224d08b82 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:48.852255 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b5234557-7dd9-49b9-b0a7-561224d08b82 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:48.865695 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b5234557-7dd9-49b9-b0a7-561224d08b82 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1554 microversion: 2.1 time: 0.289663 Jul 25 12:18:48.880043 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 296/585] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:48 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1554 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:18:48.886454 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-dbd522e2-e9e2-42db-b857-bf57b9be1c58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:48.887576 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-dbd522e2-e9e2-42db-b857-bf57b9be1c58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:48.894608 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dbd522e2-e9e2-42db-b857-bf57b9be1c58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:48.895043 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dbd522e2-e9e2-42db-b857-bf57b9be1c58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:48.896066 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dbd522e2-e9e2-42db-b857-bf57b9be1c58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:48.896568 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-dbd522e2-e9e2-42db-b857-bf57b9be1c58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:49.038425 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eaf9330e-31c3-400b-8cbb-4b07cf62dfa7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:49.047271 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eaf9330e-31c3-400b-8cbb-4b07cf62dfa7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:49.049150 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-eaf9330e-31c3-400b-8cbb-4b07cf62dfa7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:49.050403 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-eaf9330e-31c3-400b-8cbb-4b07cf62dfa7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1722 microversion: 2.20 time: 0.656031 Jul 25 12:18:49.051164 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 290/586] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:18:48 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1722 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:18:49.108625 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-dbd522e2-e9e2-42db-b857-bf57b9be1c58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:49.117183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-dbd522e2-e9e2-42db-b857-bf57b9be1c58 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1367 microversion: 2.1 time: 0.235954 Jul 25 12:18:49.117773 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 297/587] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:48 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:49.516888 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e64ada25-a10f-40b2-a1ef-0fab1f8dd2c6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:49.517529 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e64ada25-a10f-40b2-a1ef-0fab1f8dd2c6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:49.523977 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e64ada25-a10f-40b2-a1ef-0fab1f8dd2c6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:49.524430 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e64ada25-a10f-40b2-a1ef-0fab1f8dd2c6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:49.525194 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e64ada25-a10f-40b2-a1ef-0fab1f8dd2c6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:49.526085 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e64ada25-a10f-40b2-a1ef-0fab1f8dd2c6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:49.793518 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-c853832a-8ac7-40da-87e0-bb6ecc5065f1 req-57cfdef1-7180-4908-abf3-6a6f5bd899a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6facc5-40af-42cb-80fe-268e5a380a6b", "name": "network-vif-deleted", "tag": "18e2de81-a509-4850-99c1-f87dfe2e51c2"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:49.799022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:49.800373 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=8 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:49.808036 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-c853832a-8ac7-40da-87e0-bb6ecc5065f1 req-57cfdef1-7180-4908-abf3-6a6f5bd899a0 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:49.808481 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-c853832a-8ac7-40da-87e0-bb6ecc5065f1 req-57cfdef1-7180-4908-abf3-6a6f5bd899a0 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:49.820539 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-c853832a-8ac7-40da-87e0-bb6ecc5065f1 req-57cfdef1-7180-4908-abf3-6a6f5bd899a0 service nova] Creating event network-vif-deleted:18e2de81-a509-4850-99c1-f87dfe2e51c2 for instance 5d6facc5-40af-42cb-80fe-268e5a380a6b on hv-cinder-79760 Jul 25 12:18:49.825632 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-c853832a-8ac7-40da-87e0-bb6ecc5065f1 req-57cfdef1-7180-4908-abf3-6a6f5bd899a0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036225 Jul 25 12:18:49.826407 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 298/588] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:18:49.841438 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e64ada25-a10f-40b2-a1ef-0fab1f8dd2c6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:49.849501 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e64ada25-a10f-40b2-a1ef-0fab1f8dd2c6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.337100 Jul 25 12:18:49.850063 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 291/589] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:49 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:49.887618 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b750cc06-6ba4-4088-9a4a-b7adf9f7c7a4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:49.888418 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b750cc06-6ba4-4088-9a4a-b7adf9f7c7a4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:49.894810 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b750cc06-6ba4-4088-9a4a-b7adf9f7c7a4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:49.895260 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b750cc06-6ba4-4088-9a4a-b7adf9f7c7a4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:49.896057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b750cc06-6ba4-4088-9a4a-b7adf9f7c7a4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:49.896520 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b750cc06-6ba4-4088-9a4a-b7adf9f7c7a4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:49.973107 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b750cc06-6ba4-4088-9a4a-b7adf9f7c7a4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6250801fc4f74b2180533687e8cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63781e2ea3b43b48fc5a065fea7bad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:49.985717 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b750cc06-6ba4-4088-9a4a-b7adf9f7c7a4 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 200 len: 1512 microversion: 2.1 time: 0.102295 Jul 25 12:18:49.987709 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 299/590] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:49 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 1512 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:50.083312 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-85f90b48-8424-4064-9baf-ad95c23d1cef tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:50.084539 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-85f90b48-8424-4064-9baf-ad95c23d1cef tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:50.090812 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-85f90b48-8424-4064-9baf-ad95c23d1cef tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:50.091643 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-85f90b48-8424-4064-9baf-ad95c23d1cef tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:50.092826 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-85f90b48-8424-4064-9baf-ad95c23d1cef tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:50.093494 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-85f90b48-8424-4064-9baf-ad95c23d1cef tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:50.137636 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-85b4ae2c-d1fe-4bbe-8f1b-b56413aaa91c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:50.138250 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-85b4ae2c-d1fe-4bbe-8f1b-b56413aaa91c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:50.144784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85b4ae2c-d1fe-4bbe-8f1b-b56413aaa91c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:50.146162 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85b4ae2c-d1fe-4bbe-8f1b-b56413aaa91c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:50.146961 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85b4ae2c-d1fe-4bbe-8f1b-b56413aaa91c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:50.147399 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85b4ae2c-d1fe-4bbe-8f1b-b56413aaa91c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:50.181693 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-85f90b48-8424-4064-9baf-ad95c23d1cef tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:50.190254 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-85f90b48-8424-4064-9baf-ad95c23d1cef tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:50.192071 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-85f90b48-8424-4064-9baf-ad95c23d1cef tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:50.193639 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-85f90b48-8424-4064-9baf-ad95c23d1cef tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 200 len: 1654 microversion: 2.20 time: 0.122535 Jul 25 12:18:50.208005 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 292/591] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:18:50 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 1654 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:18:50.298318 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-85b4ae2c-d1fe-4bbe-8f1b-b56413aaa91c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:50.306095 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-85b4ae2c-d1fe-4bbe-8f1b-b56413aaa91c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1367 microversion: 2.1 time: 0.172201 Jul 25 12:18:50.307039 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 300/592] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:50 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:18:50.872773 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-718656cb-0ba3-43d5-90df-450087af0c81 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:50.873906 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-718656cb-0ba3-43d5-90df-450087af0c81 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:50.880810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-718656cb-0ba3-43d5-90df-450087af0c81 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:50.881405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-718656cb-0ba3-43d5-90df-450087af0c81 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:50.882279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-718656cb-0ba3-43d5-90df-450087af0c81 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:50.882812 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-718656cb-0ba3-43d5-90df-450087af0c81 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:50.888185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:51.009775 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-36027ae6-32ad-453d-a368-989d89ce2e35 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:51.010384 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-36027ae6-32ad-453d-a368-989d89ce2e35 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] [instance: 5d6facc5-40af-42cb-80fe-268e5a380a6b] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:51.019837 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36027ae6-32ad-453d-a368-989d89ce2e35 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:51.020293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36027ae6-32ad-453d-a368-989d89ce2e35 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:51.021097 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36027ae6-32ad-453d-a368-989d89ce2e35 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:51.021580 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36027ae6-32ad-453d-a368-989d89ce2e35 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:51.022271 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-718656cb-0ba3-43d5-90df-450087af0c81 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:51.031042 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-718656cb-0ba3-43d5-90df-450087af0c81 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.163152 Jul 25 12:18:51.032303 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 293/593] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:50 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:51.038212 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-36027ae6-32ad-453d-a368-989d89ce2e35 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] HTTP exception thrown: Instance 5d6facc5-40af-42cb-80fe-268e5a380a6b could not be found. Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-36027ae6-32ad-453d-a368-989d89ce2e35 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Request method failure captured: Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b HTTP/1.1 Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3ol0KUl9hLuGU2QmCTnKaYc4YL9Mt-H-IGGrw0A0Ijqat4bPjphRFh3o-BV1BKmjCJ1JjUy1ITrEix9JHJM8pz_LEjdaCVpk8JPgEUEiFeLxNAx3EW1xMxL9CFJa9lVMAFlIDxEZwfE9igBTJcQ8GKQmH0kz842mwKxOmkBdY7TYU1o Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: f63781e2ea3b43b48fc5a065fea7bad4 Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-TestMinimumBasicScenario-734729338 Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:18:51.039875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:18:51.041264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f63781e2ea3b43b48fc5a065fea7bad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f63781e2ea3b43b48fc5a065fea7bad4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f63781e2ea3b43b48fc5a065fea7bad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f63781e2ea3b43b48fc5a065fea7bad4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:18:51.041264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-TestMinimumBasicScenario-734729338 Jul 25 12:18:51.041264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: f63781e2ea3b43b48fc5a065fea7bad4 Jul 25 12:18:51.041264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-TestMinimumBasicScenario-734729338 Jul 25 12:18:51.041264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-TestMinimumBasicScenario-734729338-project Jul 25 12:18:51.041264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:18:51.041264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:18:51.041264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 5ea6250801fc4f74b2180533687e8cf2 Jul 25 12:18:51.041264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-TestMinimumBasicScenario-734729338-project Jul 25 12:18:51.041264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:18:51.041264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 5d6facc5-40af-42cb-80fe-268e5a380a6b could not be found. Jul 25 12:18:51.041264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '5d6facc5-40af-42cb-80fe-268e5a380a6b'} Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6facc5-40af-42cb-80fe-268e5a380a6b could not be found. Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:18:51.042022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6facc5-40af-42cb-80fe-268e5a380a6b could not be found. Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6facc5-40af-42cb-80fe-268e5a380a6b could not be found. Jul 25 12:18:51.043296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:51.044486 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-36027ae6-32ad-453d-a368-989d89ce2e35 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Returning 404 to user: Instance 5d6facc5-40af-42cb-80fe-268e5a380a6b could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:18:51.044486 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-36027ae6-32ad-453d-a368-989d89ce2e35 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b" status: 404 len: 111 microversion: 2.1 time: 0.035800 Jul 25 12:18:51.044486 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 301/594] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:51 2022] GET /compute/v2.1/servers/5d6facc5-40af-42cb-80fe-268e5a380a6b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:18:51.053306 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-401a625f-e1e0-431a-b097-cd029ef9e4c5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] Calling method '.version_select at 0x7f942c2439d0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:51.063267 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-c7e8d92e-310f-4763-a39a-153ae6e0fd23 req-69b1008d-16b9-4e31-81d8-5d9f6ce10421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf2bada-8518-4f83-8d6b-abe45ffe638f", "name": "network-vif-plugged", "status": "completed", "tag": "77667b73-2775-4d94-a310-daa16b6ca4d0"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:51.073070 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-c7e8d92e-310f-4763-a39a-153ae6e0fd23 req-69b1008d-16b9-4e31-81d8-5d9f6ce10421 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:51.073748 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-c7e8d92e-310f-4763-a39a-153ae6e0fd23 req-69b1008d-16b9-4e31-81d8-5d9f6ce10421 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:51.074588 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-401a625f-e1e0-431a-b097-cd029ef9e4c5 tempest-TestMinimumBasicScenario-734729338 tempest-TestMinimumBasicScenario-734729338-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1432640239" status: 202 len: 0 microversion: 2.1 time: 0.024717 Jul 25 12:18:51.075748 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 294/595] 10.222.0.42 () {58 vars in 1272 bytes} [Mon Jul 25 12:18:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1432640239 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:18:51.089294 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-c7e8d92e-310f-4763-a39a-153ae6e0fd23 req-69b1008d-16b9-4e31-81d8-5d9f6ce10421 service nova] Creating event network-vif-plugged:77667b73-2775-4d94-a310-daa16b6ca4d0 for instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f on hv-cinder-79760 Jul 25 12:18:51.094743 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-c7e8d92e-310f-4763-a39a-153ae6e0fd23 req-69b1008d-16b9-4e31-81d8-5d9f6ce10421 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035804 Jul 25 12:18:51.095334 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 302/596] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:18:51.225159 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f03b1647-3ded-4739-bb19-e6b8130f639a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:51.225974 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f03b1647-3ded-4739-bb19-e6b8130f639a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:51.240373 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f03b1647-3ded-4739-bb19-e6b8130f639a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:51.240818 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f03b1647-3ded-4739-bb19-e6b8130f639a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:51.244403 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f03b1647-3ded-4739-bb19-e6b8130f639a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:51.245839 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f03b1647-3ded-4739-bb19-e6b8130f639a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:51.275684 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-f03b1647-3ded-4739-bb19-e6b8130f639a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] HTTP exception thrown: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f03b1647-3ded-4739-bb19-e6b8130f639a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Request method failure captured: Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 HTTP/1.1 Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3ok16A8FqW4XdaonxWY03tsi-aNjmig20H5gvRHrXA0awGw5qgTMqIxS7dY5WTU_Vo4TPwsvXZ7BODvwk9Iip_dQmcFx11s7-9FBz_sDAKFYdz4QnlCuHt8_331UYo-gWlVOZ1imuI-mXKGnqIJ0-4YrNL7Hd5PKNiBJ3o9H0PTFB2I Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: aef3a5bd8ffa43718ea02647f1f74fc8 Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:18:51.277405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:18:51.279124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:18:51.279124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:18:51.279124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: aef3a5bd8ffa43718ea02647f1f74fc8 Jul 25 12:18:51.279124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:18:51.279124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeShelveTestJSON-1946517150-project Jul 25 12:18:51.279124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:18:51.279124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:18:51.279124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: d2d6f10a6fe841e5b1d12bce78f97d91 Jul 25 12:18:51.279124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1946517150-project Jul 25 12:18:51.279124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:18:51.279124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:18:51.279124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': '66654721-31e2-48d8-a0ea-c146d277ab47'} Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:18:51.280533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:18:51.281853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:18:51.283429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f03b1647-3ded-4739-bb19-e6b8130f639a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Returning 404 to user: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:18:51.283429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f03b1647-3ded-4739-bb19-e6b8130f639a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 404 len: 111 microversion: 2.20 time: 0.065263 Jul 25 12:18:51.283429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 295/597] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:18:51 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:18:51.289242 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-22741a63-ac1d-4920-83c5-de11d3d24c86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '.version_select at 0x7f942c4cd8b0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:51.316952 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-22741a63-ac1d-4920-83c5-de11d3d24c86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-560487720" status: 204 len: 0 microversion: 2.20 time: 0.032491 Jul 25 12:18:51.317679 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 303/598] 10.222.0.42 () {60 vars in 1259 bytes} [Mon Jul 25 12:18:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-560487720 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 12:18:51.328185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e2312edf-2b3f-41ea-b094-ba4ec399db41 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:51.329025 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e2312edf-2b3f-41ea-b094-ba4ec399db41 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:51.337763 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2312edf-2b3f-41ea-b094-ba4ec399db41 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:51.338333 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2312edf-2b3f-41ea-b094-ba4ec399db41 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:51.339595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2312edf-2b3f-41ea-b094-ba4ec399db41 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:51.340051 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e2312edf-2b3f-41ea-b094-ba4ec399db41 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:51.555715 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e2312edf-2b3f-41ea-b094-ba4ec399db41 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:51.569296 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e2312edf-2b3f-41ea-b094-ba4ec399db41 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1367 microversion: 2.1 time: 0.246869 Jul 25 12:18:51.569870 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 296/599] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:51 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:51.844516 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-d10a40ef-16d0-4a24-a7ad-3dd80d904fa4 req-9b051366-386f-47dd-ba0e-ff8de78f536b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66654721-31e2-48d8-a0ea-c146d277ab47", "name": "network-vif-deleted", "tag": "d01f3ff0-df08-4605-a057-7920ee080060"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:51.854954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-d10a40ef-16d0-4a24-a7ad-3dd80d904fa4 req-9b051366-386f-47dd-ba0e-ff8de78f536b service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:51.855397 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-d10a40ef-16d0-4a24-a7ad-3dd80d904fa4 req-9b051366-386f-47dd-ba0e-ff8de78f536b service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:51.866492 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-d10a40ef-16d0-4a24-a7ad-3dd80d904fa4 req-9b051366-386f-47dd-ba0e-ff8de78f536b service nova] Creating event network-vif-deleted:d01f3ff0-df08-4605-a057-7920ee080060 for instance 66654721-31e2-48d8-a0ea-c146d277ab47 on hv-cinder-79760 Jul 25 12:18:51.871315 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-d10a40ef-16d0-4a24-a7ad-3dd80d904fa4 req-9b051366-386f-47dd-ba0e-ff8de78f536b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031564 Jul 25 12:18:51.874000 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 304/600] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:52.049683 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-97e637c2-7c5e-4627-bb5e-20aa028e1028 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Action: 'create', calling method: .version_select at 0x7f942c1a6820>, body: {"keypair": {"name": "tempest-keypair-1282082106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3nxg3zBp9SJQwoD0n9FPD8aoNh1B5kBLMOjIl/OoBoiInnZuEXblC3ERK1C32zkJc7HEAs4druLk+TrCZl8v1Jfk7Vl6DeKTRLGciUpF0myGHIhBOzmog+tA0LWJocwA=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:52.058633 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-48c029a4-3f99-404a-a16b-f077f1e530d6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:52.059337 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-48c029a4-3f99-404a-a16b-f077f1e530d6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:52.068911 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48c029a4-3f99-404a-a16b-f077f1e530d6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:52.069366 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48c029a4-3f99-404a-a16b-f077f1e530d6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:52.070152 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48c029a4-3f99-404a-a16b-f077f1e530d6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:52.070588 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-48c029a4-3f99-404a-a16b-f077f1e530d6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:52.077013 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-97e637c2-7c5e-4627-bb5e-20aa028e1028 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Getting quotas for project aef3a5bd8ffa43718ea02647f1f74fc8. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:18:52.081170 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-97e637c2-7c5e-4627-bb5e-20aa028e1028 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Getting quotas for user d2d6f10a6fe841e5b1d12bce78f97d91 and project aef3a5bd8ffa43718ea02647f1f74fc8. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:18:52.105568 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-97e637c2-7c5e-4627-bb5e-20aa028e1028 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.059756 Jul 25 12:18:52.106162 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 297/601] 10.222.0.42 () {62 vars in 1200 bytes} [Mon Jul 25 12:18:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 12:18:52.525809 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-48c029a4-3f99-404a-a16b-f077f1e530d6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:52.534693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-48c029a4-3f99-404a-a16b-f077f1e530d6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.480093 Jul 25 12:18:52.535788 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 305/602] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:52 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:52.590853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e5269ece-02c5-4174-8741-86a76f068b45 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:52.591990 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e5269ece-02c5-4174-8741-86a76f068b45 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:52.598415 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5269ece-02c5-4174-8741-86a76f068b45 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:52.599088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5269ece-02c5-4174-8741-86a76f068b45 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:52.600088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5269ece-02c5-4174-8741-86a76f068b45 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:52.600678 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e5269ece-02c5-4174-8741-86a76f068b45 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:52.826206 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e5269ece-02c5-4174-8741-86a76f068b45 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:52.836616 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e5269ece-02c5-4174-8741-86a76f068b45 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1367 microversion: 2.1 time: 0.250383 Jul 25 12:18:52.837591 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 298/603] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:52 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:53.558161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ed344fd3-4715-4e5a-8b25-7f3c78913bdc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:53.560178 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ed344fd3-4715-4e5a-8b25-7f3c78913bdc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:53.568148 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ed344fd3-4715-4e5a-8b25-7f3c78913bdc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:53.569646 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ed344fd3-4715-4e5a-8b25-7f3c78913bdc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:53.570724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ed344fd3-4715-4e5a-8b25-7f3c78913bdc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:53.571887 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ed344fd3-4715-4e5a-8b25-7f3c78913bdc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:53.582287 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-862787850", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36635bbd-0783-4ae1-9364-d8aba7145b80"}], "security_groups": [{"name": "tempest-securitygroup--524028105"}], "key_name": "tempest-keypair-1282082106", "user_data": "}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:53.738107 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ed344fd3-4715-4e5a-8b25-7f3c78913bdc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:53.746974 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ed344fd3-4715-4e5a-8b25-7f3c78913bdc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.192524 Jul 25 12:18:53.748045 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 306/604] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:53 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:53.858501 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-28eb5dca-17de-4871-abdd-1a3238b597eb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:53.859534 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-28eb5dca-17de-4871-abdd-1a3238b597eb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:53.865886 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28eb5dca-17de-4871-abdd-1a3238b597eb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:53.866653 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28eb5dca-17de-4871-abdd-1a3238b597eb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:53.867510 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28eb5dca-17de-4871-abdd-1a3238b597eb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:53.868034 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-28eb5dca-17de-4871-abdd-1a3238b597eb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:54.007142 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] validate_networks() for [('36635bbd-0783-4ae1-9364-d8aba7145b80', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:18:54.016027 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-28eb5dca-17de-4871-abdd-1a3238b597eb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:54.024541 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-28eb5dca-17de-4871-abdd-1a3238b597eb tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1558 microversion: 2.1 time: 0.169735 Jul 25 12:18:54.036543 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 307/605] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:53 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:54.044948 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9987610a-9111-4289-b7be-b4cd1f450cad tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:54.045562 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9987610a-9111-4289-b7be-b4cd1f450cad tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:54.051899 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9987610a-9111-4289-b7be-b4cd1f450cad tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:54.052418 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9987610a-9111-4289-b7be-b4cd1f450cad tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:54.053556 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9987610a-9111-4289-b7be-b4cd1f450cad tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:54.054077 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9987610a-9111-4289-b7be-b4cd1f450cad tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:54.136349 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9987610a-9111-4289-b7be-b4cd1f450cad tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095329 Jul 25 12:18:54.136947 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 308/606] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Jul 25 12:18:54 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:54.661781 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:18:54.664343 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:18:54.665021 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:18:54.666352 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:18:54.666940 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:18:54.703605 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:54.705369 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:54.706307 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:54.706756 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:54.769358 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2cf61c11-94cf-4381-b720-a21e9543ba92 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:54.770024 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2cf61c11-94cf-4381-b720-a21e9543ba92 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:54.778622 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2cf61c11-94cf-4381-b720-a21e9543ba92 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:54.780028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2cf61c11-94cf-4381-b720-a21e9543ba92 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:54.781320 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2cf61c11-94cf-4381-b720-a21e9543ba92 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:54.782510 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2cf61c11-94cf-4381-b720-a21e9543ba92 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:54.784670 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Getting quotas for project aef3a5bd8ffa43718ea02647f1f74fc8. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:18:54.789999 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Getting quotas for user d2d6f10a6fe841e5b1d12bce78f97d91 and project aef3a5bd8ffa43718ea02647f1f74fc8. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:18:54.819449 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:18:54.821946 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:18:54.881186 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1086a376-f891-4cf7-82fd-72cf433a0ea0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.303192 Jul 25 12:18:54.882087 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 299/607] 10.222.0.42 () {62 vars in 1188 bytes} [Mon Jul 25 12:18:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 12:18:54.897909 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-548bc56c-dc18-44c4-9408-9247f4fbcc76 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:54.898518 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-548bc56c-dc18-44c4-9408-9247f4fbcc76 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:55.033684 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-548bc56c-dc18-44c4-9408-9247f4fbcc76 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:55.044023 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-548bc56c-dc18-44c4-9408-9247f4fbcc76 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:55.045577 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-548bc56c-dc18-44c4-9408-9247f4fbcc76 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:55.046688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-548bc56c-dc18-44c4-9408-9247f4fbcc76 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1281 microversion: 2.20 time: 0.156990 Jul 25 12:18:55.047242 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 300/608] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:18:54 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1281 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:18:55.093222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2cf61c11-94cf-4381-b720-a21e9543ba92 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:55.108586 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2cf61c11-94cf-4381-b720-a21e9543ba92 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.343745 Jul 25 12:18:55.109530 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 309/609] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:54 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:18:55.423417 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-7662b9ea-c542-40a4-9417-6368221b1bd5 req-c76f55b8-b143-4e73-8230-366105bc2a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf2bada-8518-4f83-8d6b-abe45ffe638f", "tag": "77667b73-2775-4d94-a310-daa16b6ca4d0"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:55.438145 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-7662b9ea-c542-40a4-9417-6368221b1bd5 req-c76f55b8-b143-4e73-8230-366105bc2a2d service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:55.438735 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-7662b9ea-c542-40a4-9417-6368221b1bd5 req-c76f55b8-b143-4e73-8230-366105bc2a2d service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:55.452985 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-7662b9ea-c542-40a4-9417-6368221b1bd5 req-c76f55b8-b143-4e73-8230-366105bc2a2d service nova] Creating event network-changed:77667b73-2775-4d94-a310-daa16b6ca4d0 for instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f on hv-cinder-79760 Jul 25 12:18:55.458834 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-7662b9ea-c542-40a4-9417-6368221b1bd5 req-c76f55b8-b143-4e73-8230-366105bc2a2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040924 Jul 25 12:18:55.460357 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 301/610] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:18:56.070061 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bda6f704-ace7-4eb1-88f1-0a2c68db5a50 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:56.070684 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bda6f704-ace7-4eb1-88f1-0a2c68db5a50 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:56.086804 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bda6f704-ace7-4eb1-88f1-0a2c68db5a50 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:56.088041 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bda6f704-ace7-4eb1-88f1-0a2c68db5a50 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:56.089468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bda6f704-ace7-4eb1-88f1-0a2c68db5a50 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:56.090483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bda6f704-ace7-4eb1-88f1-0a2c68db5a50 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:56.135091 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6a4313b7-3c7e-4f77-a5e9-5eac409a9907 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:56.136011 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6a4313b7-3c7e-4f77-a5e9-5eac409a9907 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:56.152287 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a4313b7-3c7e-4f77-a5e9-5eac409a9907 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:56.153344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a4313b7-3c7e-4f77-a5e9-5eac409a9907 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:56.155378 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a4313b7-3c7e-4f77-a5e9-5eac409a9907 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:56.156062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6a4313b7-3c7e-4f77-a5e9-5eac409a9907 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:56.202996 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bda6f704-ace7-4eb1-88f1-0a2c68db5a50 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:56.212805 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bda6f704-ace7-4eb1-88f1-0a2c68db5a50 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:56.214959 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bda6f704-ace7-4eb1-88f1-0a2c68db5a50 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:56.216114 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bda6f704-ace7-4eb1-88f1-0a2c68db5a50 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1333 microversion: 2.20 time: 0.150025 Jul 25 12:18:56.231495 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 310/611] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:18:56 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1333 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:18:56.418340 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6a4313b7-3c7e-4f77-a5e9-5eac409a9907 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:56.428902 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6a4313b7-3c7e-4f77-a5e9-5eac409a9907 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1735 microversion: 2.1 time: 0.299653 Jul 25 12:18:56.429576 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 302/612] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:56 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1735 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:57.239326 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6b3886b6-882e-4919-b9df-2e1102479a40 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:57.240069 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6b3886b6-882e-4919-b9df-2e1102479a40 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:57.246919 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b3886b6-882e-4919-b9df-2e1102479a40 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:57.247370 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b3886b6-882e-4919-b9df-2e1102479a40 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:57.248164 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b3886b6-882e-4919-b9df-2e1102479a40 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:57.248596 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6b3886b6-882e-4919-b9df-2e1102479a40 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:57.308961 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6b3886b6-882e-4919-b9df-2e1102479a40 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:57.317221 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6b3886b6-882e-4919-b9df-2e1102479a40 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:57.318753 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6b3886b6-882e-4919-b9df-2e1102479a40 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:57.319863 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6b3886b6-882e-4919-b9df-2e1102479a40 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1339 microversion: 2.20 time: 0.084440 Jul 25 12:18:57.320423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 311/613] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:18:57 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1339 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:18:57.451665 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c7deecda-2149-45b4-96ed-f9b7391c2cfc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:57.452323 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c7deecda-2149-45b4-96ed-f9b7391c2cfc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:57.458719 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7deecda-2149-45b4-96ed-f9b7391c2cfc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:57.459168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7deecda-2149-45b4-96ed-f9b7391c2cfc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:57.459959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7deecda-2149-45b4-96ed-f9b7391c2cfc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:57.460392 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c7deecda-2149-45b4-96ed-f9b7391c2cfc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:57.832878 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c7deecda-2149-45b4-96ed-f9b7391c2cfc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:57.841515 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c7deecda-2149-45b4-96ed-f9b7391c2cfc tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1715 microversion: 2.1 time: 0.394200 Jul 25 12:18:57.842217 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 303/614] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:57 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1715 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:57.955264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4e498c67-0320-438e-a31c-88b2c41fc055 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:57.955788 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4e498c67-0320-438e-a31c-88b2c41fc055 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:57.963635 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e498c67-0320-438e-a31c-88b2c41fc055 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:57.964093 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e498c67-0320-438e-a31c-88b2c41fc055 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:57.964873 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e498c67-0320-438e-a31c-88b2c41fc055 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:57.965356 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e498c67-0320-438e-a31c-88b2c41fc055 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:58.048060 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-4e498c67-0320-438e-a31c-88b2c41fc055 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] HTTP exception thrown: Cannot 'detach_volume' instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 while it is in vm_state rescued Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4e498c67-0320-438e-a31c-88b2c41fc055 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Request method failure captured: Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: DELETE /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-volume_attachments/f7343d37-1595-4927-a7c7-152ce059d9e3 HTTP/1.1 Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3ok95f1--OwMYyUO5AGbD5Z4dHg-jMGrNWEmk2P6lT01K8JUrcVV0YVdqEq8o-tTjrUfy5Y7jIVtvlBCIfFf8Cgi4_T5AOp8BBkuL66TB06rqEy43oBVdOKCQsvoVboB9KLGYCm0UW4LDW9mxQW3-OyhTABwIATZuCV3W1wPXNw5dA0 Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 2d9f339447114912b0c92b99e028fbbf Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:18:58.049924 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:18:58.051402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:18:58.051402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:18:58.051402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 2d9f339447114912b0c92b99e028fbbf Jul 25 12:18:58.051402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:18:58.051402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-ServerRescueNegativeTestJSON-1430226500-project Jul 25 12:18:58.051402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:18:58.051402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:18:58.051402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: a766d17b116f498fab07efb69c94e49e Jul 25 12:18:58.051402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1430226500-project Jul 25 12:18:58.051402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:18:58.051402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Cannot 'detach_volume' instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 while it is in vm_state rescued Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'server_id': '0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0', 'id': 'f7343d37-1595-4927-a7c7-152ce059d9e3'} Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:18:58.052112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 while it is in vm_state rescued Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 while it is in vm_state rescued Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:18:58.053488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4e498c67-0320-438e-a31c-88b2c41fc055 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Returning 409 to user: Cannot 'detach_volume' instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 while it is in vm_state rescued {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:18:58.054606 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4e498c67-0320-438e-a31c-88b2c41fc055 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-volume_attachments/f7343d37-1595-4927-a7c7-152ce059d9e3" status: 409 len: 152 microversion: 2.1 time: 0.100305 Jul 25 12:18:58.054606 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 312/615] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Jul 25 12:18:57 2022] DELETE /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-volume_attachments/f7343d37-1595-4927-a7c7-152ce059d9e3 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:18:58.064318 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5344d9de-551c-4f93-a75f-5badc87fbc50 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:18:58.064855 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5344d9de-551c-4f93-a75f-5badc87fbc50 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:58.070730 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5344d9de-551c-4f93-a75f-5badc87fbc50 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:58.071198 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5344d9de-551c-4f93-a75f-5badc87fbc50 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:58.072236 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5344d9de-551c-4f93-a75f-5badc87fbc50 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:58.072784 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5344d9de-551c-4f93-a75f-5badc87fbc50 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:58.140548 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5344d9de-551c-4f93-a75f-5badc87fbc50 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "POST /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/action" status: 202 len: 0 microversion: 2.1 time: 0.080728 Jul 25 12:18:58.141192 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 304/616] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:18:58 2022] POST /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:18:58.150095 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-17e1d8f9-1698-464a-85ec-630659b42c2e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:58.150720 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-17e1d8f9-1698-464a-85ec-630659b42c2e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:58.160565 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17e1d8f9-1698-464a-85ec-630659b42c2e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:58.161136 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17e1d8f9-1698-464a-85ec-630659b42c2e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:58.162027 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17e1d8f9-1698-464a-85ec-630659b42c2e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:58.162631 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17e1d8f9-1698-464a-85ec-630659b42c2e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:58.320473 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-17e1d8f9-1698-464a-85ec-630659b42c2e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:58.330761 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-17e1d8f9-1698-464a-85ec-630659b42c2e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1723 microversion: 2.1 time: 0.184737 Jul 25 12:18:58.331636 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 313/617] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:58 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:58.348143 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c68a5583-4abe-4926-ade5-d4e327b7b400 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:58.349301 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c68a5583-4abe-4926-ade5-d4e327b7b400 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:58.356538 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c68a5583-4abe-4926-ade5-d4e327b7b400 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:58.357050 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c68a5583-4abe-4926-ade5-d4e327b7b400 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:58.358563 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c68a5583-4abe-4926-ade5-d4e327b7b400 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:58.359055 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c68a5583-4abe-4926-ade5-d4e327b7b400 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:58.462431 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c68a5583-4abe-4926-ade5-d4e327b7b400 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:58.471118 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c68a5583-4abe-4926-ade5-d4e327b7b400 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:58.472783 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c68a5583-4abe-4926-ade5-d4e327b7b400 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:58.474040 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c68a5583-4abe-4926-ade5-d4e327b7b400 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1339 microversion: 2.20 time: 0.130247 Jul 25 12:18:58.483588 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 305/618] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:18:58 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1339 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:18:59.353414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bd890236-d279-45a0-9559-7a797615431c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:59.353949 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bd890236-d279-45a0-9559-7a797615431c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:59.361217 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd890236-d279-45a0-9559-7a797615431c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:59.361665 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd890236-d279-45a0-9559-7a797615431c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:59.362448 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd890236-d279-45a0-9559-7a797615431c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:59.362883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bd890236-d279-45a0-9559-7a797615431c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:59.499364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0b244435-f352-4792-bda4-26246629a757 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:18:59.500007 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0b244435-f352-4792-bda4-26246629a757 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:18:59.500112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bd890236-d279-45a0-9559-7a797615431c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:59.506914 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0b244435-f352-4792-bda4-26246629a757 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:59.507388 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0b244435-f352-4792-bda4-26246629a757 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:59.508369 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0b244435-f352-4792-bda4-26246629a757 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:18:59.508482 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bd890236-d279-45a0-9559-7a797615431c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1723 microversion: 2.1 time: 0.159055 Jul 25 12:18:59.508807 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0b244435-f352-4792-bda4-26246629a757 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:18:59.517546 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 314/619] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:18:59 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:18:59.833300 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0b244435-f352-4792-bda4-26246629a757 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:59.848119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0b244435-f352-4792-bda4-26246629a757 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:59.852619 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0b244435-f352-4792-bda4-26246629a757 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:18:59.854072 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0b244435-f352-4792-bda4-26246629a757 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1406 microversion: 2.20 time: 0.359864 Jul 25 12:18:59.855385 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 306/620] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:18:59 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:19:00.308346 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-01a2900f-a836-4659-bf33-35793c9051ea req-3d9ad190-57a1-464c-8301-e6c08e415838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "716acb40-a825-4b9b-a5f2-63d87980cf7a", "tag": "d8ccc18c-ce12-4e5d-a124-191bdcd1d563"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:00.320950 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-01a2900f-a836-4659-bf33-35793c9051ea req-3d9ad190-57a1-464c-8301-e6c08e415838 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:00.323011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-01a2900f-a836-4659-bf33-35793c9051ea req-3d9ad190-57a1-464c-8301-e6c08e415838 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:00.335601 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-01a2900f-a836-4659-bf33-35793c9051ea req-3d9ad190-57a1-464c-8301-e6c08e415838 service nova] Creating event network-changed:d8ccc18c-ce12-4e5d-a124-191bdcd1d563 for instance 716acb40-a825-4b9b-a5f2-63d87980cf7a on hv-cinder-79760 Jul 25 12:19:00.341139 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-01a2900f-a836-4659-bf33-35793c9051ea req-3d9ad190-57a1-464c-8301-e6c08e415838 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036687 Jul 25 12:19:00.342358 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 315/621] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:00.530468 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-702eb145-8cf1-4267-b96e-0c897f7708ba tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:00.531177 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-702eb145-8cf1-4267-b96e-0c897f7708ba tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:00.537741 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-702eb145-8cf1-4267-b96e-0c897f7708ba tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:00.538289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-702eb145-8cf1-4267-b96e-0c897f7708ba tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:00.539137 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-702eb145-8cf1-4267-b96e-0c897f7708ba tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:00.539601 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-702eb145-8cf1-4267-b96e-0c897f7708ba tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:00.720693 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-702eb145-8cf1-4267-b96e-0c897f7708ba tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:00.730248 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-702eb145-8cf1-4267-b96e-0c897f7708ba tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1723 microversion: 2.1 time: 0.204306 Jul 25 12:19:00.730874 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 307/622] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:00 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:00.882198 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-43819cc9-3f47-4a88-82cb-de118d2ac9e0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:00.882907 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-43819cc9-3f47-4a88-82cb-de118d2ac9e0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:00.889846 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43819cc9-3f47-4a88-82cb-de118d2ac9e0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:00.890300 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43819cc9-3f47-4a88-82cb-de118d2ac9e0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:00.891062 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43819cc9-3f47-4a88-82cb-de118d2ac9e0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:00.891497 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43819cc9-3f47-4a88-82cb-de118d2ac9e0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:00.895569 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=100 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:01.100438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-43819cc9-3f47-4a88-82cb-de118d2ac9e0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:01.110109 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-43819cc9-3f47-4a88-82cb-de118d2ac9e0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:01.112508 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-43819cc9-3f47-4a88-82cb-de118d2ac9e0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:01.113697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-43819cc9-3f47-4a88-82cb-de118d2ac9e0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1406 microversion: 2.20 time: 0.238186 Jul 25 12:19:01.114454 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 316/623] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:19:00 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:19:01.756542 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-aa643b52-bc85-414d-bb1c-67d202f7f700 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:01.757157 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-aa643b52-bc85-414d-bb1c-67d202f7f700 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:01.764355 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa643b52-bc85-414d-bb1c-67d202f7f700 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:01.764831 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa643b52-bc85-414d-bb1c-67d202f7f700 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:01.765596 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa643b52-bc85-414d-bb1c-67d202f7f700 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:01.766028 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-aa643b52-bc85-414d-bb1c-67d202f7f700 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:01.917716 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-aa643b52-bc85-414d-bb1c-67d202f7f700 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:01.925879 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-aa643b52-bc85-414d-bb1c-67d202f7f700 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1723 microversion: 2.1 time: 0.173370 Jul 25 12:19:01.926439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 308/624] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:01 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:02.137929 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-636c29fe-c8bc-4995-9698-fd6c90001d80 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:02.139302 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-636c29fe-c8bc-4995-9698-fd6c90001d80 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:02.147945 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-636c29fe-c8bc-4995-9698-fd6c90001d80 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:02.148395 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-636c29fe-c8bc-4995-9698-fd6c90001d80 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:02.149169 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-636c29fe-c8bc-4995-9698-fd6c90001d80 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:02.149603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-636c29fe-c8bc-4995-9698-fd6c90001d80 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:02.304651 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-636c29fe-c8bc-4995-9698-fd6c90001d80 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:02.313185 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-636c29fe-c8bc-4995-9698-fd6c90001d80 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:02.314951 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-636c29fe-c8bc-4995-9698-fd6c90001d80 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:02.316256 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-636c29fe-c8bc-4995-9698-fd6c90001d80 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1406 microversion: 2.20 time: 0.182250 Jul 25 12:19:02.316967 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 317/625] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:19:02 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:19:02.946232 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-06c67325-1cc6-4a04-b9b3-4949611b17a1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:02.946854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-06c67325-1cc6-4a04-b9b3-4949611b17a1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:02.953991 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06c67325-1cc6-4a04-b9b3-4949611b17a1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:02.954442 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06c67325-1cc6-4a04-b9b3-4949611b17a1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:02.955221 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06c67325-1cc6-4a04-b9b3-4949611b17a1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:02.955713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-06c67325-1cc6-4a04-b9b3-4949611b17a1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:03.098752 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-06c67325-1cc6-4a04-b9b3-4949611b17a1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:03.107896 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-06c67325-1cc6-4a04-b9b3-4949611b17a1 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1729 microversion: 2.1 time: 0.164744 Jul 25 12:19:03.108515 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 309/626] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:02 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:03.129320 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-614a2572-42dd-424f-a316-c23fb70c6d6e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:03.129919 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-614a2572-42dd-424f-a316-c23fb70c6d6e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:03.136600 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-614a2572-42dd-424f-a316-c23fb70c6d6e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:03.137160 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-614a2572-42dd-424f-a316-c23fb70c6d6e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:03.138015 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-614a2572-42dd-424f-a316-c23fb70c6d6e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:03.139084 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-614a2572-42dd-424f-a316-c23fb70c6d6e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:03.221642 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-614a2572-42dd-424f-a316-c23fb70c6d6e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096200 Jul 25 12:19:03.222394 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 318/627] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Jul 25 12:19:03 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:03.339231 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0620d39a-c2ce-4f42-8e9c-c0154dc1e4c9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:03.339852 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0620d39a-c2ce-4f42-8e9c-c0154dc1e4c9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:03.346468 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0620d39a-c2ce-4f42-8e9c-c0154dc1e4c9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:03.346912 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0620d39a-c2ce-4f42-8e9c-c0154dc1e4c9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:03.347695 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0620d39a-c2ce-4f42-8e9c-c0154dc1e4c9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:03.348124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0620d39a-c2ce-4f42-8e9c-c0154dc1e4c9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:03.475988 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0620d39a-c2ce-4f42-8e9c-c0154dc1e4c9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:03.483884 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0620d39a-c2ce-4f42-8e9c-c0154dc1e4c9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:03.485377 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0620d39a-c2ce-4f42-8e9c-c0154dc1e4c9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:03.486470 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0620d39a-c2ce-4f42-8e9c-c0154dc1e4c9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1406 microversion: 2.20 time: 0.151309 Jul 25 12:19:03.487017 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 310/628] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:19:03 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:19:04.101259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-39e2980d-b71c-455e-a90c-e5856179870b req-60bd00b0-4740-4f20-8759-ccda1fc03cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0", "tag": "01fbcb44-8f5c-4f96-8ed4-469cbfa137f5"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:04.113351 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-39e2980d-b71c-455e-a90c-e5856179870b req-60bd00b0-4740-4f20-8759-ccda1fc03cdf service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:04.113351 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-39e2980d-b71c-455e-a90c-e5856179870b req-60bd00b0-4740-4f20-8759-ccda1fc03cdf service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:04.123941 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-39e2980d-b71c-455e-a90c-e5856179870b req-60bd00b0-4740-4f20-8759-ccda1fc03cdf service nova] Creating event network-changed:01fbcb44-8f5c-4f96-8ed4-469cbfa137f5 for instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 on hv-cinder-79760 Jul 25 12:19:04.128979 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-39e2980d-b71c-455e-a90c-e5856179870b req-60bd00b0-4740-4f20-8759-ccda1fc03cdf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031585 Jul 25 12:19:04.129952 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 319/629] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:04.509862 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-109a649c-1b3f-4724-ab50-acb4032b74ca tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:04.511082 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-109a649c-1b3f-4724-ab50-acb4032b74ca tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:04.518451 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-109a649c-1b3f-4724-ab50-acb4032b74ca tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:04.519034 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-109a649c-1b3f-4724-ab50-acb4032b74ca tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:04.519836 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-109a649c-1b3f-4724-ab50-acb4032b74ca tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:04.520556 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-109a649c-1b3f-4724-ab50-acb4032b74ca tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:04.730711 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-109a649c-1b3f-4724-ab50-acb4032b74ca tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:04.742010 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-109a649c-1b3f-4724-ab50-acb4032b74ca tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:04.743532 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-109a649c-1b3f-4724-ab50-acb4032b74ca tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:04.744674 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-109a649c-1b3f-4724-ab50-acb4032b74ca tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1406 microversion: 2.20 time: 0.238831 Jul 25 12:19:04.745240 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 311/630] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:19:04 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:19:05.769769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-620aef5c-1d72-4c3b-a672-160889a50ecb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:05.770387 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-620aef5c-1d72-4c3b-a672-160889a50ecb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:05.776925 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-620aef5c-1d72-4c3b-a672-160889a50ecb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:05.777380 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-620aef5c-1d72-4c3b-a672-160889a50ecb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:05.778157 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-620aef5c-1d72-4c3b-a672-160889a50ecb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:05.778595 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-620aef5c-1d72-4c3b-a672-160889a50ecb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:05.907708 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-620aef5c-1d72-4c3b-a672-160889a50ecb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:05.915649 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-620aef5c-1d72-4c3b-a672-160889a50ecb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:05.917159 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-620aef5c-1d72-4c3b-a672-160889a50ecb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:05.918294 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-620aef5c-1d72-4c3b-a672-160889a50ecb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1406 microversion: 2.20 time: 0.152923 Jul 25 12:19:05.918856 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 320/631] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:19:05 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:19:06.143319 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-baa44c04-153c-463f-8608-3ec97526cfc4 req-a2d86e32-669b-4bac-91c1-a59ed351cbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0", "tag": "01fbcb44-8f5c-4f96-8ed4-469cbfa137f5"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:06.148181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:06.148872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=12 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:06.157029 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-baa44c04-153c-463f-8608-3ec97526cfc4 req-a2d86e32-669b-4bac-91c1-a59ed351cbd3 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:06.157472 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-baa44c04-153c-463f-8608-3ec97526cfc4 req-a2d86e32-669b-4bac-91c1-a59ed351cbd3 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:06.167964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-baa44c04-153c-463f-8608-3ec97526cfc4 req-a2d86e32-669b-4bac-91c1-a59ed351cbd3 service nova] Creating event network-changed:01fbcb44-8f5c-4f96-8ed4-469cbfa137f5 for instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 on hv-cinder-79760 Jul 25 12:19:06.172616 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-baa44c04-153c-463f-8608-3ec97526cfc4 req-a2d86e32-669b-4bac-91c1-a59ed351cbd3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032983 Jul 25 12:19:06.173189 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 312/632] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:06.941354 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-473e537e-2081-43ab-a299-baff40ab440b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:06.941895 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-473e537e-2081-43ab-a299-baff40ab440b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:06.948650 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-473e537e-2081-43ab-a299-baff40ab440b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:06.949097 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-473e537e-2081-43ab-a299-baff40ab440b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:06.949920 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-473e537e-2081-43ab-a299-baff40ab440b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:06.950353 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-473e537e-2081-43ab-a299-baff40ab440b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:07.078065 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-473e537e-2081-43ab-a299-baff40ab440b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:07.085889 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-473e537e-2081-43ab-a299-baff40ab440b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:07.087389 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-473e537e-2081-43ab-a299-baff40ab440b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:07.088521 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-473e537e-2081-43ab-a299-baff40ab440b tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1406 microversion: 2.20 time: 0.151243 Jul 25 12:19:07.089094 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 321/633] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:19:06 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:19:08.111343 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-631dd56d-5c68-4e9a-8568-8823a79cb4bd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:08.112074 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-631dd56d-5c68-4e9a-8568-8823a79cb4bd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:08.118270 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-631dd56d-5c68-4e9a-8568-8823a79cb4bd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:08.118712 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-631dd56d-5c68-4e9a-8568-8823a79cb4bd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:08.119459 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-631dd56d-5c68-4e9a-8568-8823a79cb4bd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:08.119914 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-631dd56d-5c68-4e9a-8568-8823a79cb4bd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:08.246101 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-631dd56d-5c68-4e9a-8568-8823a79cb4bd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:08.254445 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-631dd56d-5c68-4e9a-8568-8823a79cb4bd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:08.255986 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-631dd56d-5c68-4e9a-8568-8823a79cb4bd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:08.257088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-631dd56d-5c68-4e9a-8568-8823a79cb4bd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1406 microversion: 2.20 time: 0.150517 Jul 25 12:19:08.257639 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 313/634] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:19:08 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:19:08.900743 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-cd212be7-cca0-479a-9b2f-1f35d7e2e1c4 req-3412628a-b0f9-44b6-8202-5c8a98c96ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "716acb40-a825-4b9b-a5f2-63d87980cf7a", "name": "network-vif-plugged", "status": "completed", "tag": "d8ccc18c-ce12-4e5d-a124-191bdcd1d563"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:08.911857 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-cd212be7-cca0-479a-9b2f-1f35d7e2e1c4 req-3412628a-b0f9-44b6-8202-5c8a98c96ae9 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:08.912327 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-cd212be7-cca0-479a-9b2f-1f35d7e2e1c4 req-3412628a-b0f9-44b6-8202-5c8a98c96ae9 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:08.923816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-cd212be7-cca0-479a-9b2f-1f35d7e2e1c4 req-3412628a-b0f9-44b6-8202-5c8a98c96ae9 service nova] Creating event network-vif-plugged:d8ccc18c-ce12-4e5d-a124-191bdcd1d563 for instance 716acb40-a825-4b9b-a5f2-63d87980cf7a on hv-cinder-79760 Jul 25 12:19:08.928519 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-cd212be7-cca0-479a-9b2f-1f35d7e2e1c4 req-3412628a-b0f9-44b6-8202-5c8a98c96ae9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031698 Jul 25 12:19:08.929152 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 322/635] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:09.281908 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3d64d36a-3f33-4dad-95c5-b57394fd5984 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:09.282446 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3d64d36a-3f33-4dad-95c5-b57394fd5984 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:09.288892 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d64d36a-3f33-4dad-95c5-b57394fd5984 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:09.289351 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d64d36a-3f33-4dad-95c5-b57394fd5984 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:09.290082 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d64d36a-3f33-4dad-95c5-b57394fd5984 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:09.290501 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d64d36a-3f33-4dad-95c5-b57394fd5984 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:09.309249 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:09.417858 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3d64d36a-3f33-4dad-95c5-b57394fd5984 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:09.425763 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3d64d36a-3f33-4dad-95c5-b57394fd5984 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:09.427263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3d64d36a-3f33-4dad-95c5-b57394fd5984 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:09.428400 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3d64d36a-3f33-4dad-95c5-b57394fd5984 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1406 microversion: 2.20 time: 0.151534 Jul 25 12:19:09.428954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 314/636] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:19:09 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:19:10.452023 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1ef7be31-9550-4d4d-9bfe-79468bca446d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:10.452722 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1ef7be31-9550-4d4d-9bfe-79468bca446d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:10.458980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ef7be31-9550-4d4d-9bfe-79468bca446d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:10.459426 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ef7be31-9550-4d4d-9bfe-79468bca446d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:10.460219 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ef7be31-9550-4d4d-9bfe-79468bca446d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:10.460657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1ef7be31-9550-4d4d-9bfe-79468bca446d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:10.589088 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1ef7be31-9550-4d4d-9bfe-79468bca446d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:10.597971 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1ef7be31-9550-4d4d-9bfe-79468bca446d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:10.599469 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1ef7be31-9550-4d4d-9bfe-79468bca446d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:10.600841 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1ef7be31-9550-4d4d-9bfe-79468bca446d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1406 microversion: 2.20 time: 0.153681 Jul 25 12:19:10.601408 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 323/637] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:19:10 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:19:11.627355 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0df42d91-7c27-470d-95e6-39eafb75bfb0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:11.627979 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0df42d91-7c27-470d-95e6-39eafb75bfb0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:11.634443 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0df42d91-7c27-470d-95e6-39eafb75bfb0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:11.634884 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0df42d91-7c27-470d-95e6-39eafb75bfb0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:11.635664 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0df42d91-7c27-470d-95e6-39eafb75bfb0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:11.636094 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0df42d91-7c27-470d-95e6-39eafb75bfb0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:11.762301 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0df42d91-7c27-470d-95e6-39eafb75bfb0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:11.770279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0df42d91-7c27-470d-95e6-39eafb75bfb0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:11.771810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0df42d91-7c27-470d-95e6-39eafb75bfb0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:11.772966 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0df42d91-7c27-470d-95e6-39eafb75bfb0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1597 microversion: 2.20 time: 0.149486 Jul 25 12:19:11.773521 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 315/638] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:19:11 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1597 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:19:11.796470 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-14da0c03-2420-44ec-936e-91fc8942240e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:11.796973 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-14da0c03-2420-44ec-936e-91fc8942240e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:11.803394 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14da0c03-2420-44ec-936e-91fc8942240e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:11.803907 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14da0c03-2420-44ec-936e-91fc8942240e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:11.804671 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14da0c03-2420-44ec-936e-91fc8942240e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:11.805112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14da0c03-2420-44ec-936e-91fc8942240e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:11.879634 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-14da0c03-2420-44ec-936e-91fc8942240e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087790 Jul 25 12:19:11.880228 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 324/639] 10.222.0.42 () {60 vars in 1316 bytes} [Mon Jul 25 12:19:11 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:19:12.709550 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9019d090-15c8-4f60-b8f1-1c0411b7391d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:12.711753 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9019d090-15c8-4f60-b8f1-1c0411b7391d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:12.715233 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:12.719532 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9019d090-15c8-4f60-b8f1-1c0411b7391d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:12.720001 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9019d090-15c8-4f60-b8f1-1c0411b7391d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:12.720785 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9019d090-15c8-4f60-b8f1-1c0411b7391d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:12.721220 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9019d090-15c8-4f60-b8f1-1c0411b7391d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:12.758163 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9019d090-15c8-4f60-b8f1-1c0411b7391d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052589 Jul 25 12:19:12.758763 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 316/640] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:19:12 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:19:12.826472 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2d337f59-5d0c-4fbb-ba9c-50770877d088 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:12.827027 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2d337f59-5d0c-4fbb-ba9c-50770877d088 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:12.833393 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d337f59-5d0c-4fbb-ba9c-50770877d088 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:12.833936 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d337f59-5d0c-4fbb-ba9c-50770877d088 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:12.834777 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d337f59-5d0c-4fbb-ba9c-50770877d088 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:12.835222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d337f59-5d0c-4fbb-ba9c-50770877d088 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:12.861283 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2d337f59-5d0c-4fbb-ba9c-50770877d088 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:19:12.939362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2d337f59-5d0c-4fbb-ba9c-50770877d088 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 204 len: 0 microversion: 2.1 time: 0.117615 Jul 25 12:19:12.941232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 325/641] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:19:12 2022] DELETE /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:19:12.949402 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7767fcb3-69eb-41ac-a548-ece454c42bc8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:12.950215 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7767fcb3-69eb-41ac-a548-ece454c42bc8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:12.957930 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7767fcb3-69eb-41ac-a548-ece454c42bc8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:12.958379 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7767fcb3-69eb-41ac-a548-ece454c42bc8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:12.959147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7767fcb3-69eb-41ac-a548-ece454c42bc8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:12.959605 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7767fcb3-69eb-41ac-a548-ece454c42bc8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:13.019126 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-cbcbcd71-42b0-426f-b58f-d4b55b328b4f req-991c020a-6945-423f-83ca-76458c5acaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "716acb40-a825-4b9b-a5f2-63d87980cf7a", "tag": "d8ccc18c-ce12-4e5d-a124-191bdcd1d563"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:13.028760 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-cbcbcd71-42b0-426f-b58f-d4b55b328b4f req-991c020a-6945-423f-83ca-76458c5acaa4 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:13.029528 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-cbcbcd71-42b0-426f-b58f-d4b55b328b4f req-991c020a-6945-423f-83ca-76458c5acaa4 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:13.040819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-cbcbcd71-42b0-426f-b58f-d4b55b328b4f req-991c020a-6945-423f-83ca-76458c5acaa4 service nova] Creating event network-changed:d8ccc18c-ce12-4e5d-a124-191bdcd1d563 for instance 716acb40-a825-4b9b-a5f2-63d87980cf7a on hv-cinder-79760 Jul 25 12:19:13.046138 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-cbcbcd71-42b0-426f-b58f-d4b55b328b4f req-991c020a-6945-423f-83ca-76458c5acaa4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030984 Jul 25 12:19:13.046719 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 326/642] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:19:13.101330 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7767fcb3-69eb-41ac-a548-ece454c42bc8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:13.110358 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7767fcb3-69eb-41ac-a548-ece454c42bc8 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1672 microversion: 2.1 time: 0.165614 Jul 25 12:19:13.111150 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 317/643] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:12 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:14.132943 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1b3465b4-f8c8-47f2-919f-f03912113afb tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:14.133629 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1b3465b4-f8c8-47f2-919f-f03912113afb tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:14.135559 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:14.142731 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b3465b4-f8c8-47f2-919f-f03912113afb tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:14.143209 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b3465b4-f8c8-47f2-919f-f03912113afb tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:14.144009 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b3465b4-f8c8-47f2-919f-f03912113afb tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:14.144475 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1b3465b4-f8c8-47f2-919f-f03912113afb tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:14.273086 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1b3465b4-f8c8-47f2-919f-f03912113afb tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:14.280828 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1b3465b4-f8c8-47f2-919f-f03912113afb tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1672 microversion: 2.1 time: 0.152510 Jul 25 12:19:14.281550 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 327/644] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:14 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:15.301868 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-100c9136-b309-4612-b1aa-088d249a752d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:15.302482 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-100c9136-b309-4612-b1aa-088d249a752d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:15.309322 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-100c9136-b309-4612-b1aa-088d249a752d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:15.309773 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-100c9136-b309-4612-b1aa-088d249a752d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:15.310531 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-100c9136-b309-4612-b1aa-088d249a752d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:15.310968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-100c9136-b309-4612-b1aa-088d249a752d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:15.626903 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-100c9136-b309-4612-b1aa-088d249a752d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:15.634763 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-100c9136-b309-4612-b1aa-088d249a752d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1672 microversion: 2.1 time: 0.336759 Jul 25 12:19:15.635334 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 318/645] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:15 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1672 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:16.633442 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-1e49c311-4139-45f3-b136-0eb28ccdb295 req-cbc39e01-73b4-4a47-bed5-a8a2c3851fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea750ca-a1eb-4a15-ad78-dddfc62d8d13", "name": "network-vif-deleted", "tag": "f2fd4c6c-baa4-4900-8f20-a81e46e1b234"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:16.646072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-1e49c311-4139-45f3-b136-0eb28ccdb295 req-cbc39e01-73b4-4a47-bed5-a8a2c3851fb7 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:16.646509 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-1e49c311-4139-45f3-b136-0eb28ccdb295 req-cbc39e01-73b4-4a47-bed5-a8a2c3851fb7 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:16.660395 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f69a4826-6283-4dc8-96d0-b65d12fc2afd tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:16.660982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-1e49c311-4139-45f3-b136-0eb28ccdb295 req-cbc39e01-73b4-4a47-bed5-a8a2c3851fb7 service nova] Creating event network-vif-deleted:f2fd4c6c-baa4-4900-8f20-a81e46e1b234 for instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 on hv-cinder-79760 Jul 25 12:19:16.661083 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f69a4826-6283-4dc8-96d0-b65d12fc2afd tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:16.666370 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-1e49c311-4139-45f3-b136-0eb28ccdb295 req-cbc39e01-73b4-4a47-bed5-a8a2c3851fb7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036438 Jul 25 12:19:16.667440 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 328/646] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:16.682121 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f69a4826-6283-4dc8-96d0-b65d12fc2afd tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:16.684859 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f69a4826-6283-4dc8-96d0-b65d12fc2afd tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:16.686112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f69a4826-6283-4dc8-96d0-b65d12fc2afd tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:16.690413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f69a4826-6283-4dc8-96d0-b65d12fc2afd tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:16.771225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f69a4826-6283-4dc8-96d0-b65d12fc2afd tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:16.789141 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f69a4826-6283-4dc8-96d0-b65d12fc2afd tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 200 len: 1322 microversion: 2.1 time: 0.136196 Jul 25 12:19:16.790038 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 319/647] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:16 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 1322 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:17.812516 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8c8e0068-f522-4530-b879-e17f6602752c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:17.813213 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8c8e0068-f522-4530-b879-e17f6602752c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:17.819386 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8c8e0068-f522-4530-b879-e17f6602752c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:17.819864 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8c8e0068-f522-4530-b879-e17f6602752c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:17.820619 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8c8e0068-f522-4530-b879-e17f6602752c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:17.821084 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8c8e0068-f522-4530-b879-e17f6602752c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:17.833947 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-8c8e0068-f522-4530-b879-e17f6602752c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] HTTP exception thrown: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8c8e0068-f522-4530-b879-e17f6602752c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Request method failure captured: Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 HTTP/1.1 Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3ok_DbuTRKK1ReZoZDULS3DEXCb4ZDORaGOFSZeUa09wwPmsFzAlhgebQxRVbm3v1R2NWqB6kAC7bpWmjIHjtpxfMhdw31oqG9qFAQM7-RgCkKKy8TJeUm_8Vz6vYWMCqBAT2Do01uIXFchd2gSmIroY1yZtNGOXldKLkOnN9QX2Aco Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: ce78c16fa24c475b945a64a7995c70e4 Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:19:17.835514 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:19:17.837063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:19:17.837063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:19:17.837063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: ce78c16fa24c475b945a64a7995c70e4 Jul 25 12:19:17.837063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:19:17.837063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeTestJSON-866303580-project Jul 25 12:19:17.837063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:19:17.837063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:19:17.837063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: c5b98bbcc2d640de837d141f83dfe924 Jul 25 12:19:17.837063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeTestJSON-866303580-project Jul 25 12:19:17.837063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:19:17.837063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:19:17.837063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '8ea750ca-a1eb-4a15-ad78-dddfc62d8d13'} Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:19:17.838206 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:19:17.839693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:19:17.841556 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8c8e0068-f522-4530-b879-e17f6602752c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Returning 404 to user: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:19:17.841556 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8c8e0068-f522-4530-b879-e17f6602752c tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 404 len: 111 microversion: 2.1 time: 0.029204 Jul 25 12:19:17.841556 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 329/648] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:17 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:19:17.846039 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-69d1743e-cc2f-4df1-a5cf-812e17652a38 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '.version_select at 0x7f942c203820>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:17.864425 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-69d1743e-cc2f-4df1-a5cf-812e17652a38 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415531527" status: 202 len: 0 microversion: 2.1 time: 0.022178 Jul 25 12:19:17.864966 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 320/649] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Jul 25 12:19:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415531527 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:19:18.470198 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e13e411c-e277-454a-a20b-b86748d806f4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Action: 'create', calling method: .version_select at 0x7f942c33d4c0>, body: {"keypair": {"name": "tempest-keypair-751287666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ90XwBRlfHDscDMnsDFxRqr66XLBl7+3ADoPAAWnbNHbZV+w6AnyAJ5MjL8dotwn1MQRJKvOmE2KYXTbKrrJhLq4ONyE8JNgcGKSPx5Dlnge32Z1GefdmUbFr63/hYvUA=="}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:18.485706 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-e13e411c-e277-454a-a20b-b86748d806f4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Getting quotas for project ce78c16fa24c475b945a64a7995c70e4. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:19:18.489504 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-e13e411c-e277-454a-a20b-b86748d806f4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Getting quotas for user c5b98bbcc2d640de837d141f83dfe924 and project ce78c16fa24c475b945a64a7995c70e4. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:19:18.510274 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e13e411c-e277-454a-a20b-b86748d806f4 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044602 Jul 25 12:19:18.510870 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 330/650] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Jul 25 12:19:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:19.776233 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-236384381", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18a1dbad-381e-4747-8a32-f7e07d523a46"}], "security_groups": [{"name": "tempest-securitygroup--484520381"}], "key_name": "tempest-keypair-751287666", "user_data": "}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:19.876381 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] validate_networks() for [('18a1dbad-381e-4747-8a32-f7e07d523a46', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:19:20.235048 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:19:20.235416 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:19:20.235930 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:19:20.236334 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:19:20.236759 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:19:20.245459 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:20.245904 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:20.247197 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:20.247668 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:20.264538 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Getting quotas for project ce78c16fa24c475b945a64a7995c70e4. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:19:20.268460 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Getting quotas for user c5b98bbcc2d640de837d141f83dfe924 and project ce78c16fa24c475b945a64a7995c70e4. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:19:20.279447 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:19:20.281673 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:19:20.326469 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e51e8c38-23bb-40c6-a1dc-f4bb827713a3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.555230 Jul 25 12:19:20.327124 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 321/651] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:19:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:19:20.338670 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c90c0bd4-f4c9-48a1-aeda-d455c2535fc3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:20.339402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c90c0bd4-f4c9-48a1-aeda-d455c2535fc3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:20.402141 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c90c0bd4-f4c9-48a1-aeda-d455c2535fc3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:20.409308 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c90c0bd4-f4c9-48a1-aeda-d455c2535fc3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1236 microversion: 2.1 time: 0.075006 Jul 25 12:19:20.409950 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 331/652] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:20 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:21.430867 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7382aff9-9b15-410f-b599-25238279dc6e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:21.431588 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7382aff9-9b15-410f-b599-25238279dc6e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:21.439110 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7382aff9-9b15-410f-b599-25238279dc6e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:21.439590 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7382aff9-9b15-410f-b599-25238279dc6e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:21.440383 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7382aff9-9b15-410f-b599-25238279dc6e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:21.440820 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7382aff9-9b15-410f-b599-25238279dc6e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:21.514722 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7382aff9-9b15-410f-b599-25238279dc6e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:21.522300 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7382aff9-9b15-410f-b599-25238279dc6e tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1294 microversion: 2.1 time: 0.095912 Jul 25 12:19:21.522868 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 322/653] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:21 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:22.545426 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cd22dbcb-46ba-4390-9393-da6097e5969d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:22.546177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cd22dbcb-46ba-4390-9393-da6097e5969d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:22.552805 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd22dbcb-46ba-4390-9393-da6097e5969d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:22.553250 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd22dbcb-46ba-4390-9393-da6097e5969d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:22.554018 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd22dbcb-46ba-4390-9393-da6097e5969d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:22.554446 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cd22dbcb-46ba-4390-9393-da6097e5969d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:22.697460 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cd22dbcb-46ba-4390-9393-da6097e5969d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:22.707019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cd22dbcb-46ba-4390-9393-da6097e5969d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1361 microversion: 2.1 time: 0.166351 Jul 25 12:19:22.708954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 332/654] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:22 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:22.747159 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-7565cd42-880d-4972-829a-db418caec5ab req-834419c6-0f7f-4842-bfe8-3a5d285a820c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031", "tag": "f559cf1f-0667-4b67-ada9-e67f8af17d57"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:22.761187 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-7565cd42-880d-4972-829a-db418caec5ab req-834419c6-0f7f-4842-bfe8-3a5d285a820c service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:22.761634 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-7565cd42-880d-4972-829a-db418caec5ab req-834419c6-0f7f-4842-bfe8-3a5d285a820c service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:22.781515 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-7565cd42-880d-4972-829a-db418caec5ab req-834419c6-0f7f-4842-bfe8-3a5d285a820c service nova] Creating event network-changed:f559cf1f-0667-4b67-ada9-e67f8af17d57 for instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 on hv-cinder-79760 Jul 25 12:19:22.786450 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-7565cd42-880d-4972-829a-db418caec5ab req-834419c6-0f7f-4842-bfe8-3a5d285a820c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043229 Jul 25 12:19:22.787050 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 323/655] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:23.729691 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-36281f55-5364-4d5f-a95a-dc5e72cc2393 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:23.730355 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-36281f55-5364-4d5f-a95a-dc5e72cc2393 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:23.737172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36281f55-5364-4d5f-a95a-dc5e72cc2393 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:23.737622 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36281f55-5364-4d5f-a95a-dc5e72cc2393 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:23.738388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36281f55-5364-4d5f-a95a-dc5e72cc2393 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:23.738822 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-36281f55-5364-4d5f-a95a-dc5e72cc2393 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:23.869107 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-36281f55-5364-4d5f-a95a-dc5e72cc2393 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:23.877012 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-36281f55-5364-4d5f-a95a-dc5e72cc2393 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1361 microversion: 2.1 time: 0.151208 Jul 25 12:19:23.877573 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 333/656] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:23 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:24.905863 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2bdb416d-0c76-42f1-81d2-6c2abfe31e73 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:24.906497 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2bdb416d-0c76-42f1-81d2-6c2abfe31e73 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:24.912869 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2bdb416d-0c76-42f1-81d2-6c2abfe31e73 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:24.913316 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2bdb416d-0c76-42f1-81d2-6c2abfe31e73 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:24.914079 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2bdb416d-0c76-42f1-81d2-6c2abfe31e73 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:24.914511 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2bdb416d-0c76-42f1-81d2-6c2abfe31e73 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:25.045955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2bdb416d-0c76-42f1-81d2-6c2abfe31e73 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:25.053365 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2bdb416d-0c76-42f1-81d2-6c2abfe31e73 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1361 microversion: 2.1 time: 0.153211 Jul 25 12:19:25.053932 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 324/657] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:24 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:26.073850 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-44049e34-cd15-478b-a9eb-195da00ece15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:26.074473 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-44049e34-cd15-478b-a9eb-195da00ece15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:26.080893 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44049e34-cd15-478b-a9eb-195da00ece15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:26.081329 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44049e34-cd15-478b-a9eb-195da00ece15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:26.082072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44049e34-cd15-478b-a9eb-195da00ece15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:26.082498 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44049e34-cd15-478b-a9eb-195da00ece15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:26.213905 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-44049e34-cd15-478b-a9eb-195da00ece15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:26.221678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-44049e34-cd15-478b-a9eb-195da00ece15 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1361 microversion: 2.1 time: 0.151646 Jul 25 12:19:26.222238 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 334/658] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:26 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:27.242289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5ef2ddf7-ed35-48a3-aadf-ebaceb181c68 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:27.243006 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5ef2ddf7-ed35-48a3-aadf-ebaceb181c68 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:27.250397 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5ef2ddf7-ed35-48a3-aadf-ebaceb181c68 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:27.250839 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5ef2ddf7-ed35-48a3-aadf-ebaceb181c68 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:27.251612 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5ef2ddf7-ed35-48a3-aadf-ebaceb181c68 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:27.252041 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5ef2ddf7-ed35-48a3-aadf-ebaceb181c68 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:27.386994 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5ef2ddf7-ed35-48a3-aadf-ebaceb181c68 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:27.396963 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5ef2ddf7-ed35-48a3-aadf-ebaceb181c68 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1361 microversion: 2.1 time: 0.158444 Jul 25 12:19:27.398646 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 325/659] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:27 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:19:28.418202 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7d6e1df0-9ef8-49b6-92e8-7c7b1c487107 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:28.418803 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7d6e1df0-9ef8-49b6-92e8-7c7b1c487107 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:28.425318 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d6e1df0-9ef8-49b6-92e8-7c7b1c487107 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:28.425763 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d6e1df0-9ef8-49b6-92e8-7c7b1c487107 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:28.426509 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d6e1df0-9ef8-49b6-92e8-7c7b1c487107 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:28.426937 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7d6e1df0-9ef8-49b6-92e8-7c7b1c487107 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:28.553240 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7d6e1df0-9ef8-49b6-92e8-7c7b1c487107 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:28.561120 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7d6e1df0-9ef8-49b6-92e8-7c7b1c487107 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1361 microversion: 2.1 time: 0.146788 Jul 25 12:19:28.561686 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 335/660] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:28 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:28.962886 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-c7e66207-be30-49ed-ba3c-be7519a47727 req-e6f6862f-5cf8-4abd-9a64-97758bab6a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031", "name": "network-vif-plugged", "status": "completed", "tag": "f559cf1f-0667-4b67-ada9-e67f8af17d57"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:28.974098 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-c7e66207-be30-49ed-ba3c-be7519a47727 req-e6f6862f-5cf8-4abd-9a64-97758bab6a9e service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:28.974546 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-c7e66207-be30-49ed-ba3c-be7519a47727 req-e6f6862f-5cf8-4abd-9a64-97758bab6a9e service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:28.986500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-c7e66207-be30-49ed-ba3c-be7519a47727 req-e6f6862f-5cf8-4abd-9a64-97758bab6a9e service nova] Creating event network-vif-plugged:f559cf1f-0667-4b67-ada9-e67f8af17d57 for instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 on hv-cinder-79760 Jul 25 12:19:28.991164 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-c7e66207-be30-49ed-ba3c-be7519a47727 req-e6f6862f-5cf8-4abd-9a64-97758bab6a9e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031910 Jul 25 12:19:28.991782 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 326/661] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:29.581485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2d72e60e-cea6-4257-9725-c60ff3d930d1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:29.582098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2d72e60e-cea6-4257-9725-c60ff3d930d1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:29.588546 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d72e60e-cea6-4257-9725-c60ff3d930d1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:29.589001 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d72e60e-cea6-4257-9725-c60ff3d930d1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:29.590463 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d72e60e-cea6-4257-9725-c60ff3d930d1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:29.590897 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2d72e60e-cea6-4257-9725-c60ff3d930d1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:29.720188 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2d72e60e-cea6-4257-9725-c60ff3d930d1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:29.727451 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2d72e60e-cea6-4257-9725-c60ff3d930d1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1361 microversion: 2.1 time: 0.149800 Jul 25 12:19:29.728045 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 336/662] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:29 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:30.746231 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:30.746922 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:30.750888 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-67e43612-3b3d-491b-9ab6-a72af5445192 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:30.751620 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-67e43612-3b3d-491b-9ab6-a72af5445192 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:30.758602 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67e43612-3b3d-491b-9ab6-a72af5445192 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:30.759042 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67e43612-3b3d-491b-9ab6-a72af5445192 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:30.759811 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67e43612-3b3d-491b-9ab6-a72af5445192 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:30.760237 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-67e43612-3b3d-491b-9ab6-a72af5445192 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:30.890635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-67e43612-3b3d-491b-9ab6-a72af5445192 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:30.898010 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-67e43612-3b3d-491b-9ab6-a72af5445192 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1361 microversion: 2.1 time: 0.153751 Jul 25 12:19:30.898574 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 327/663] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:30 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:31.919284 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c0f44b11-504f-408e-ab90-c2158d81bea1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:31.919922 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c0f44b11-504f-408e-ab90-c2158d81bea1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:31.921848 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:31.927878 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c0f44b11-504f-408e-ab90-c2158d81bea1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:31.928321 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c0f44b11-504f-408e-ab90-c2158d81bea1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:31.929077 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c0f44b11-504f-408e-ab90-c2158d81bea1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:31.929506 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c0f44b11-504f-408e-ab90-c2158d81bea1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:31.933499 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:32.059769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c0f44b11-504f-408e-ab90-c2158d81bea1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:32.067040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c0f44b11-504f-408e-ab90-c2158d81bea1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1546 microversion: 2.1 time: 0.151709 Jul 25 12:19:32.067621 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 337/664] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:31 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:32.088066 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-283d309a-f632-44fe-9f67-2290ac16a5ea tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:32.088555 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-283d309a-f632-44fe-9f67-2290ac16a5ea tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:32.094930 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-283d309a-f632-44fe-9f67-2290ac16a5ea tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:32.095380 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-283d309a-f632-44fe-9f67-2290ac16a5ea tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:32.096174 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-283d309a-f632-44fe-9f67-2290ac16a5ea tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:32.096618 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-283d309a-f632-44fe-9f67-2290ac16a5ea tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:32.170982 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-283d309a-f632-44fe-9f67-2290ac16a5ea tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086747 Jul 25 12:19:32.171634 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 328/665] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Jul 25 12:19:32 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:33.328789 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-c95e50d5-5730-4be6-bd94-d58b8db24e43 req-8cf9da22-618f-4acc-ba52-7522e2df71bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031", "tag": "f559cf1f-0667-4b67-ada9-e67f8af17d57"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:33.338550 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-c95e50d5-5730-4be6-bd94-d58b8db24e43 req-8cf9da22-618f-4acc-ba52-7522e2df71bc service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:33.338980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-c95e50d5-5730-4be6-bd94-d58b8db24e43 req-8cf9da22-618f-4acc-ba52-7522e2df71bc service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:33.350228 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-c95e50d5-5730-4be6-bd94-d58b8db24e43 req-8cf9da22-618f-4acc-ba52-7522e2df71bc service nova] Creating event network-changed:f559cf1f-0667-4b67-ada9-e67f8af17d57 for instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 on hv-cinder-79760 Jul 25 12:19:33.355178 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-c95e50d5-5730-4be6-bd94-d58b8db24e43 req-8cf9da22-618f-4acc-ba52-7522e2df71bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029963 Jul 25 12:19:33.356129 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 338/666] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:33.594077 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ff260611-441f-40eb-a064-7fc9741fb452 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:33.594577 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ff260611-441f-40eb-a064-7fc9741fb452 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:33.600761 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff260611-441f-40eb-a064-7fc9741fb452 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:33.601290 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff260611-441f-40eb-a064-7fc9741fb452 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:33.602159 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff260611-441f-40eb-a064-7fc9741fb452 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:33.602586 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ff260611-441f-40eb-a064-7fc9741fb452 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:33.626688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ff260611-441f-40eb-a064-7fc9741fb452 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/ips" status: 200 len: 150 microversion: 2.1 time: 0.036896 Jul 25 12:19:33.627431 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 329/667] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Jul 25 12:19:33 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:34.993921 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-666d2808-fc83-4610-9d59-91bae9be1845 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37de49f7-ec02-44c2-bf42-5f1aa0f92e08"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:34.996912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-666d2808-fc83-4610-9d59-91bae9be1845 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:35.003330 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-666d2808-fc83-4610-9d59-91bae9be1845 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:35.003813 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-666d2808-fc83-4610-9d59-91bae9be1845 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:35.004574 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-666d2808-fc83-4610-9d59-91bae9be1845 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:35.005013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-666d2808-fc83-4610-9d59-91bae9be1845 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:35.247522 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-666d2808-fc83-4610-9d59-91bae9be1845 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "POST /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258418 Jul 25 12:19:35.248258 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 339/668] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:19:34 2022] POST /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:42.063607 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-33c5c6ec-7817-456b-b322-e6b9150c5256 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:42.064101 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-33c5c6ec-7817-456b-b322-e6b9150c5256 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:42.070352 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33c5c6ec-7817-456b-b322-e6b9150c5256 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:42.070786 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33c5c6ec-7817-456b-b322-e6b9150c5256 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:42.071534 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33c5c6ec-7817-456b-b322-e6b9150c5256 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:42.071988 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-33c5c6ec-7817-456b-b322-e6b9150c5256 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:42.075708 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=71 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:42.304830 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-33c5c6ec-7817-456b-b322-e6b9150c5256 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lazy-loading 'services' on Instance uuid 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:19:42.374982 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-33c5c6ec-7817-456b-b322-e6b9150c5256 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-volume_attachments/f7343d37-1595-4927-a7c7-152ce059d9e3" status: 202 len: 0 microversion: 2.1 time: 0.315094 Jul 25 12:19:42.375690 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 330/669] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Jul 25 12:19:42 2022] DELETE /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-volume_attachments/f7343d37-1595-4927-a7c7-152ce059d9e3 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:19:42.385175 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2dd053c6-7fd3-42c3-b62e-5aa995041c21 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:42.388029 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2dd053c6-7fd3-42c3-b62e-5aa995041c21 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:42.394272 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2dd053c6-7fd3-42c3-b62e-5aa995041c21 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:42.394779 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2dd053c6-7fd3-42c3-b62e-5aa995041c21 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:42.395721 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2dd053c6-7fd3-42c3-b62e-5aa995041c21 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:42.396363 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2dd053c6-7fd3-42c3-b62e-5aa995041c21 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:42.429780 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2dd053c6-7fd3-42c3-b62e-5aa995041c21 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049460 Jul 25 12:19:42.430472 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 340/670] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:19:42 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:42.761224 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b2b9c7a5-932f-49f9-804c-1a6f96d31567 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37de49f7-ec02-44c2-bf42-5f1aa0f92e08"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:42.763738 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b2b9c7a5-932f-49f9-804c-1a6f96d31567 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:42.765680 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:42.773898 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2b9c7a5-932f-49f9-804c-1a6f96d31567 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:42.774569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2b9c7a5-932f-49f9-804c-1a6f96d31567 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:42.775797 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2b9c7a5-932f-49f9-804c-1a6f96d31567 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:42.776507 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2b9c7a5-932f-49f9-804c-1a6f96d31567 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:42.863373 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-b2b9c7a5-932f-49f9-804c-1a6f96d31567 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Invalid volume: volume 37de49f7-ec02-44c2-bf42-5f1aa0f92e08 is already attached to instances: 6cf2bada-8518-4f83-8d6b-abe45ffe638f Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b2b9c7a5-932f-49f9-804c-1a6f96d31567 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: POST /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments HTTP/1.1 Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 74 Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:19:42.865129 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:19:42.866410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:19:42.866410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:19:42.866410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:19:42.866410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:19:42.866410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:19:42.866410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:19:42.866410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:19:42.866410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:19:42.866410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:19:42.866410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Jul 25 12:19:42.866410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {"volumeAttachment": {"volumeId": "37de49f7-ec02-44c2-bf42-5f1aa0f92e08"}} Jul 25 12:19:42.866410 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Invalid volume: volume 37de49f7-ec02-44c2-bf42-5f1aa0f92e08 is already attached to instances: 6cf2bada-8518-4f83-8d6b-abe45ffe638f Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'server_id': '6cf2bada-8518-4f83-8d6b-abe45ffe638f', 'body': {'volumeAttachment': {'volumeId': '37de49f7-ec02-44c2-bf42-5f1aa0f92e08'}}} Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 37de49f7-ec02-44c2-bf42-5f1aa0f92e08 is already attached to instances: 6cf2bada-8518-4f83-8d6b-abe45ffe638f Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:42.867105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 37de49f7-ec02-44c2-bf42-5f1aa0f92e08 is already attached to instances: 6cf2bada-8518-4f83-8d6b-abe45ffe638f Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:42.868854 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:19:42.871062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:19:42.871062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:19:42.871062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:19:42.871062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 37de49f7-ec02-44c2-bf42-5f1aa0f92e08 is already attached to instances: 6cf2bada-8518-4f83-8d6b-abe45ffe638f Jul 25 12:19:42.871062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:42.871062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b2b9c7a5-932f-49f9-804c-1a6f96d31567 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 400 to user: Invalid volume: volume 37de49f7-ec02-44c2-bf42-5f1aa0f92e08 is already attached to instances: 6cf2bada-8518-4f83-8d6b-abe45ffe638f {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:19:42.871062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b2b9c7a5-932f-49f9-804c-1a6f96d31567 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "POST /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109740 Jul 25 12:19:42.871062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 331/671] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:19:42 2022] POST /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:19:42.933006 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e1d092be-ee82-4760-8508-c0b13422b4d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:42.933520 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e1d092be-ee82-4760-8508-c0b13422b4d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:42.940225 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e1d092be-ee82-4760-8508-c0b13422b4d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:42.940672 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e1d092be-ee82-4760-8508-c0b13422b4d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:42.941435 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e1d092be-ee82-4760-8508-c0b13422b4d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:42.941867 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e1d092be-ee82-4760-8508-c0b13422b4d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:43.075201 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-e1d092be-ee82-4760-8508-c0b13422b4d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lazy-loading 'services' on Instance uuid 6cf2bada-8518-4f83-8d6b-abe45ffe638f {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:19:43.149643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e1d092be-ee82-4760-8508-c0b13422b4d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments/37de49f7-ec02-44c2-bf42-5f1aa0f92e08" status: 202 len: 0 microversion: 2.1 time: 0.220667 Jul 25 12:19:43.150432 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 341/672] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Jul 25 12:19:42 2022] DELETE /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments/37de49f7-ec02-44c2-bf42-5f1aa0f92e08 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:19:43.159430 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-73a99035-562f-41da-a52c-a1d2b724d38c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:43.162272 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-73a99035-562f-41da-a52c-a1d2b724d38c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:43.171569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73a99035-562f-41da-a52c-a1d2b724d38c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:43.172041 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73a99035-562f-41da-a52c-a1d2b724d38c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:43.173610 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73a99035-562f-41da-a52c-a1d2b724d38c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:43.174047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73a99035-562f-41da-a52c-a1d2b724d38c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:43.206999 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-73a99035-562f-41da-a52c-a1d2b724d38c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051451 Jul 25 12:19:43.207652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 332/673] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:19:43 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:43.442869 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7a50dd04-3fd2-4566-b1d7-e920d2da3815 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:43.445409 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7a50dd04-3fd2-4566-b1d7-e920d2da3815 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:43.452167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7a50dd04-3fd2-4566-b1d7-e920d2da3815 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:43.452638 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7a50dd04-3fd2-4566-b1d7-e920d2da3815 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:43.453402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7a50dd04-3fd2-4566-b1d7-e920d2da3815 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:43.453838 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7a50dd04-3fd2-4566-b1d7-e920d2da3815 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:43.483179 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7a50dd04-3fd2-4566-b1d7-e920d2da3815 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044668 Jul 25 12:19:43.483783 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 342/674] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:19:43 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:19:43.561589 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0aa7d8ed-6faf-430a-a6b0-829661ea2aef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:43.562088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0aa7d8ed-6faf-430a-a6b0-829661ea2aef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:43.568142 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0aa7d8ed-6faf-430a-a6b0-829661ea2aef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:43.568589 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0aa7d8ed-6faf-430a-a6b0-829661ea2aef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:43.569345 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0aa7d8ed-6faf-430a-a6b0-829661ea2aef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:43.569782 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0aa7d8ed-6faf-430a-a6b0-829661ea2aef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:43.593942 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0aa7d8ed-6faf-430a-a6b0-829661ea2aef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:19:43.675830 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0aa7d8ed-6faf-430a-a6b0-829661ea2aef tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 204 len: 0 microversion: 2.1 time: 0.117697 Jul 25 12:19:43.676397 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 333/675] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:19:43 2022] DELETE /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:19:43.685701 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-79571c82-6fe4-40ae-b3f6-05d4beee9227 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:43.686317 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-79571c82-6fe4-40ae-b3f6-05d4beee9227 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:43.692637 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79571c82-6fe4-40ae-b3f6-05d4beee9227 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:43.693138 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79571c82-6fe4-40ae-b3f6-05d4beee9227 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:43.693848 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79571c82-6fe4-40ae-b3f6-05d4beee9227 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:43.694285 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-79571c82-6fe4-40ae-b3f6-05d4beee9227 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:43.829733 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-79571c82-6fe4-40ae-b3f6-05d4beee9227 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:43.837172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-79571c82-6fe4-40ae-b3f6-05d4beee9227 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1689 microversion: 2.1 time: 0.156526 Jul 25 12:19:43.837735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 343/676] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:43 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:44.219311 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ad68619b-4961-4ef6-ab96-f397db017552 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:44.221584 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ad68619b-4961-4ef6-ab96-f397db017552 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:44.228075 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ad68619b-4961-4ef6-ab96-f397db017552 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:44.228597 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ad68619b-4961-4ef6-ab96-f397db017552 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:44.229306 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ad68619b-4961-4ef6-ab96-f397db017552 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:44.229746 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ad68619b-4961-4ef6-ab96-f397db017552 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:44.261208 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ad68619b-4961-4ef6-ab96-f397db017552 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045482 Jul 25 12:19:44.261767 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 334/677] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:19:44 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:44.859390 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-46932ed6-a3cf-403f-b14e-0b77b8e16cfb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:44.860034 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-46932ed6-a3cf-403f-b14e-0b77b8e16cfb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:44.862424 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:44.867948 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-46932ed6-a3cf-403f-b14e-0b77b8e16cfb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:44.868402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-46932ed6-a3cf-403f-b14e-0b77b8e16cfb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:44.869164 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-46932ed6-a3cf-403f-b14e-0b77b8e16cfb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:44.869637 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-46932ed6-a3cf-403f-b14e-0b77b8e16cfb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:45.001522 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-46932ed6-a3cf-403f-b14e-0b77b8e16cfb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:45.009190 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-46932ed6-a3cf-403f-b14e-0b77b8e16cfb tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1689 microversion: 2.1 time: 0.153759 Jul 25 12:19:45.009744 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 344/678] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:44 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:45.273344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d032a71f-97ef-4e7e-adc8-6fe4b324e769 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:45.275568 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d032a71f-97ef-4e7e-adc8-6fe4b324e769 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:45.282793 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d032a71f-97ef-4e7e-adc8-6fe4b324e769 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:45.283236 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d032a71f-97ef-4e7e-adc8-6fe4b324e769 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:45.284022 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d032a71f-97ef-4e7e-adc8-6fe4b324e769 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:45.284454 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d032a71f-97ef-4e7e-adc8-6fe4b324e769 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:45.312470 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d032a71f-97ef-4e7e-adc8-6fe4b324e769 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043055 Jul 25 12:19:45.313030 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 335/679] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:19:45 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:46.030011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0ecb9f77-4ed4-41ea-9bdf-d80e78d70948 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:46.030662 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0ecb9f77-4ed4-41ea-9bdf-d80e78d70948 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:46.037153 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ecb9f77-4ed4-41ea-9bdf-d80e78d70948 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:46.037546 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ecb9f77-4ed4-41ea-9bdf-d80e78d70948 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:46.038299 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ecb9f77-4ed4-41ea-9bdf-d80e78d70948 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:46.038729 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0ecb9f77-4ed4-41ea-9bdf-d80e78d70948 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:46.163125 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0ecb9f77-4ed4-41ea-9bdf-d80e78d70948 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:46.171111 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0ecb9f77-4ed4-41ea-9bdf-d80e78d70948 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1689 microversion: 2.1 time: 0.145356 Jul 25 12:19:46.171700 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 345/680] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:46 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1689 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:46.324631 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-95ba815f-c4fc-4979-b380-31dc5218055b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:46.326798 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-95ba815f-c4fc-4979-b380-31dc5218055b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:46.333260 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95ba815f-c4fc-4979-b380-31dc5218055b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:46.333704 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95ba815f-c4fc-4979-b380-31dc5218055b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:46.334456 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95ba815f-c4fc-4979-b380-31dc5218055b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:46.334883 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95ba815f-c4fc-4979-b380-31dc5218055b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:46.363738 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-95ba815f-c4fc-4979-b380-31dc5218055b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043106 Jul 25 12:19:46.364279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 336/681] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:19:46 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:19:47.192783 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ce548cef-c7f4-4a47-b462-b236f0298a4e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:47.193391 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ce548cef-c7f4-4a47-b462-b236f0298a4e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:47.200529 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce548cef-c7f4-4a47-b462-b236f0298a4e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:47.200975 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce548cef-c7f4-4a47-b462-b236f0298a4e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:47.201732 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce548cef-c7f4-4a47-b462-b236f0298a4e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:47.202176 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ce548cef-c7f4-4a47-b462-b236f0298a4e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:47.337921 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ce548cef-c7f4-4a47-b462-b236f0298a4e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:47.345619 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ce548cef-c7f4-4a47-b462-b236f0298a4e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1689 microversion: 2.1 time: 0.156825 Jul 25 12:19:47.346114 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 346/682] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:47 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:47.376415 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-15ff120c-c4f9-4ef3-873e-9d5639bf131b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:47.378528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-15ff120c-c4f9-4ef3-873e-9d5639bf131b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:47.384894 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15ff120c-c4f9-4ef3-873e-9d5639bf131b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:47.385366 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15ff120c-c4f9-4ef3-873e-9d5639bf131b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:47.386122 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15ff120c-c4f9-4ef3-873e-9d5639bf131b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:47.386547 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15ff120c-c4f9-4ef3-873e-9d5639bf131b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:47.416293 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-15ff120c-c4f9-4ef3-873e-9d5639bf131b tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043815 Jul 25 12:19:47.417363 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 337/683] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:19:47 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:48.367194 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3acfc07c-c3a6-4f02-9e3c-57e8257003f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:48.368345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3acfc07c-c3a6-4f02-9e3c-57e8257003f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:48.374943 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3acfc07c-c3a6-4f02-9e3c-57e8257003f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:48.375388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3acfc07c-c3a6-4f02-9e3c-57e8257003f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:48.376251 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3acfc07c-c3a6-4f02-9e3c-57e8257003f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:48.376680 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3acfc07c-c3a6-4f02-9e3c-57e8257003f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:48.424368 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-6d28e5a4-aeda-49f5-b886-ca396e7860b3 req-64c8bf94-f463-4e33-84f1-640e6ff47442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0", "name": "network-vif-deleted", "tag": "01fbcb44-8f5c-4f96-8ed4-469cbfa137f5"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:48.435137 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-6d28e5a4-aeda-49f5-b886-ca396e7860b3 req-64c8bf94-f463-4e33-84f1-640e6ff47442 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:48.435619 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-6d28e5a4-aeda-49f5-b886-ca396e7860b3 req-64c8bf94-f463-4e33-84f1-640e6ff47442 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:48.448299 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-6d28e5a4-aeda-49f5-b886-ca396e7860b3 req-64c8bf94-f463-4e33-84f1-640e6ff47442 service nova] Creating event network-vif-deleted:01fbcb44-8f5c-4f96-8ed4-469cbfa137f5 for instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 on hv-cinder-79760 Jul 25 12:19:48.454263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-6d28e5a4-aeda-49f5-b886-ca396e7860b3 req-64c8bf94-f463-4e33-84f1-640e6ff47442 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035462 Jul 25 12:19:48.458439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 338/684] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:48.460376 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3acfc07c-c3a6-4f02-9e3c-57e8257003f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:48.464596 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cf2a0405-3add-445b-96a7-660d26a47eab tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:48.466847 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cf2a0405-3add-445b-96a7-660d26a47eab tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:48.469678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3acfc07c-c3a6-4f02-9e3c-57e8257003f2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1622 microversion: 2.1 time: 0.106245 Jul 25 12:19:48.473762 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf2a0405-3add-445b-96a7-660d26a47eab tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:48.474214 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf2a0405-3add-445b-96a7-660d26a47eab tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:48.475234 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf2a0405-3add-445b-96a7-660d26a47eab tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:48.475880 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cf2a0405-3add-445b-96a7-660d26a47eab tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:48.502151 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 347/685] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:48 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1622 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:48.537944 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cf2a0405-3add-445b-96a7-660d26a47eab tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077901 Jul 25 12:19:48.538967 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 339/686] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:19:48 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:19:48.624169 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-43d9c12d-5ad0-41b3-ad8a-e058026b7fd8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:48.624779 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-43d9c12d-5ad0-41b3-ad8a-e058026b7fd8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:48.631513 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43d9c12d-5ad0-41b3-ad8a-e058026b7fd8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:48.632309 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43d9c12d-5ad0-41b3-ad8a-e058026b7fd8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:48.633229 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43d9c12d-5ad0-41b3-ad8a-e058026b7fd8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:48.633738 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43d9c12d-5ad0-41b3-ad8a-e058026b7fd8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:48.662118 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-43d9c12d-5ad0-41b3-ad8a-e058026b7fd8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:19:48.750222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-43d9c12d-5ad0-41b3-ad8a-e058026b7fd8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 204 len: 0 microversion: 2.1 time: 0.130321 Jul 25 12:19:48.751035 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 348/687] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:19:48 2022] DELETE /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:19:48.759611 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bb9a95de-117d-428e-abe1-d48787be38b6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:48.760821 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bb9a95de-117d-428e-abe1-d48787be38b6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:48.766710 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb9a95de-117d-428e-abe1-d48787be38b6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:48.767155 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb9a95de-117d-428e-abe1-d48787be38b6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:48.767987 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb9a95de-117d-428e-abe1-d48787be38b6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:48.768379 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bb9a95de-117d-428e-abe1-d48787be38b6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:48.906778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bb9a95de-117d-428e-abe1-d48787be38b6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:48.915594 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bb9a95de-117d-428e-abe1-d48787be38b6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1682 microversion: 2.1 time: 0.160169 Jul 25 12:19:48.916851 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 340/688] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:48 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:49.491486 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-af0fb008-bc37-403c-89e8-d41ae5eef0e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:49.492139 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-af0fb008-bc37-403c-89e8-d41ae5eef0e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:49.499090 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af0fb008-bc37-403c-89e8-d41ae5eef0e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:49.499568 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af0fb008-bc37-403c-89e8-d41ae5eef0e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:49.500349 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af0fb008-bc37-403c-89e8-d41ae5eef0e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:49.500785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af0fb008-bc37-403c-89e8-d41ae5eef0e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:49.534380 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af0fb008-bc37-403c-89e8-d41ae5eef0e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:49.534836 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-af0fb008-bc37-403c-89e8-d41ae5eef0e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:49.535291 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-af0fb008-bc37-403c-89e8-d41ae5eef0e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lazy-loading 'fault' on Instance uuid 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:19:49.578100 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-af0fb008-bc37-403c-89e8-d41ae5eef0e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:49.585774 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-af0fb008-bc37-403c-89e8-d41ae5eef0e9 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 200 len: 1336 microversion: 2.1 time: 0.098568 Jul 25 12:19:49.586347 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 349/689] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:49 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 1336 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:49.937243 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3d3e492f-0658-4b85-9d5b-c5e9101f37af tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:49.937853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3d3e492f-0658-4b85-9d5b-c5e9101f37af tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:49.944276 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d3e492f-0658-4b85-9d5b-c5e9101f37af tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:49.944721 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d3e492f-0658-4b85-9d5b-c5e9101f37af tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:49.945494 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d3e492f-0658-4b85-9d5b-c5e9101f37af tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:49.945916 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d3e492f-0658-4b85-9d5b-c5e9101f37af tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:50.075803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3d3e492f-0658-4b85-9d5b-c5e9101f37af tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:50.083196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3d3e492f-0658-4b85-9d5b-c5e9101f37af tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1682 microversion: 2.1 time: 0.149801 Jul 25 12:19:50.083791 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 341/690] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:49 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:50.607902 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9d4a3863-1214-4d04-82b5-a01e8a6c3077 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:50.609131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9d4a3863-1214-4d04-82b5-a01e8a6c3077 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:50.615757 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d4a3863-1214-4d04-82b5-a01e8a6c3077 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:50.616202 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d4a3863-1214-4d04-82b5-a01e8a6c3077 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:50.616998 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d4a3863-1214-4d04-82b5-a01e8a6c3077 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:50.617431 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9d4a3863-1214-4d04-82b5-a01e8a6c3077 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:50.631926 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-9d4a3863-1214-4d04-82b5-a01e8a6c3077 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] HTTP exception thrown: Instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 could not be found. Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9d4a3863-1214-4d04-82b5-a01e8a6c3077 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Request method failure captured: Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 HTTP/1.1 Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3ok95f1--OwMYyUO5AGbD5Z4dHg-jMGrNWEmk2P6lT01K8JUrcVV0YVdqEq8o-tTjrUfy5Y7jIVtvlBCIfFf8Cgi4_T5AOp8BBkuL66TB06rqEy43oBVdOKCQsvoVboB9KLGYCm0UW4LDW9mxQW3-OyhTABwIATZuCV3W1wPXNw5dA0 Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 2d9f339447114912b0c92b99e028fbbf Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:19:50.633583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:19:50.634912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:19:50.634912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:19:50.634912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 2d9f339447114912b0c92b99e028fbbf Jul 25 12:19:50.634912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:19:50.634912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-ServerRescueNegativeTestJSON-1430226500-project Jul 25 12:19:50.634912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:19:50.634912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:19:50.634912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: a766d17b116f498fab07efb69c94e49e Jul 25 12:19:50.634912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1430226500-project Jul 25 12:19:50.634912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:19:50.634912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 could not be found. Jul 25 12:19:50.634912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0'} Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 could not be found. Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:19:50.635735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 could not be found. Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 could not be found. Jul 25 12:19:50.636986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:19:50.638213 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9d4a3863-1214-4d04-82b5-a01e8a6c3077 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Returning 404 to user: Instance 0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:19:50.638213 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9d4a3863-1214-4d04-82b5-a01e8a6c3077 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0" status: 404 len: 111 microversion: 2.1 time: 0.031544 Jul 25 12:19:50.638213 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 350/691] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:50 2022] GET /compute/v2.1/servers/0f0b5cb6-f403-4abc-aceb-5135a6a6a2a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:19:50.643574 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d49a8f1c-93f2-461f-bf14-a4ca682df741 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '.version_select at 0x7f942c38c5e0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:50.662387 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d49a8f1c-93f2-461f-bf14-a4ca682df741 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1995308901" status: 202 len: 0 microversion: 2.1 time: 0.022542 Jul 25 12:19:50.663038 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 342/692] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Jul 25 12:19:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1995308901 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:19:51.105061 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-efab86d8-2c0b-4e9a-b57f-ee1dfcf39754 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:51.105836 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-efab86d8-2c0b-4e9a-b57f-ee1dfcf39754 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:51.112382 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efab86d8-2c0b-4e9a-b57f-ee1dfcf39754 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:51.112837 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efab86d8-2c0b-4e9a-b57f-ee1dfcf39754 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:51.113607 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efab86d8-2c0b-4e9a-b57f-ee1dfcf39754 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:51.114043 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-efab86d8-2c0b-4e9a-b57f-ee1dfcf39754 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:51.116811 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:51.246644 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-efab86d8-2c0b-4e9a-b57f-ee1dfcf39754 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:51.256584 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-efab86d8-2c0b-4e9a-b57f-ee1dfcf39754 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1682 microversion: 2.1 time: 0.156129 Jul 25 12:19:51.276616 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 351/693] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:51 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:52.039516 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-cb1714a6-e878-4c6a-adc4-991d215992d0 req-95e94ea7-2cd0-4e64-a891-529b9b299505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf2bada-8518-4f83-8d6b-abe45ffe638f", "name": "network-vif-deleted", "tag": "77667b73-2775-4d94-a310-daa16b6ca4d0"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:52.054329 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-cb1714a6-e878-4c6a-adc4-991d215992d0 req-95e94ea7-2cd0-4e64-a891-529b9b299505 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:52.055112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-cb1714a6-e878-4c6a-adc4-991d215992d0 req-95e94ea7-2cd0-4e64-a891-529b9b299505 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:52.070458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-cb1714a6-e878-4c6a-adc4-991d215992d0 req-95e94ea7-2cd0-4e64-a891-529b9b299505 service nova] Creating event network-vif-deleted:77667b73-2775-4d94-a310-daa16b6ca4d0 for instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f on hv-cinder-79760 Jul 25 12:19:52.077573 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-cb1714a6-e878-4c6a-adc4-991d215992d0 req-95e94ea7-2cd0-4e64-a891-529b9b299505 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043132 Jul 25 12:19:52.078505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 343/694] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:52.279710 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-45ebfd18-2fa9-4177-8961-cb47626fab54 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:52.280241 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-45ebfd18-2fa9-4177-8961-cb47626fab54 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:52.286667 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-45ebfd18-2fa9-4177-8961-cb47626fab54 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:52.287115 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-45ebfd18-2fa9-4177-8961-cb47626fab54 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:52.287906 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-45ebfd18-2fa9-4177-8961-cb47626fab54 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:52.288343 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-45ebfd18-2fa9-4177-8961-cb47626fab54 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:52.318872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-45ebfd18-2fa9-4177-8961-cb47626fab54 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:52.319324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-45ebfd18-2fa9-4177-8961-cb47626fab54 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:52.319804 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-45ebfd18-2fa9-4177-8961-cb47626fab54 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lazy-loading 'fault' on Instance uuid 6cf2bada-8518-4f83-8d6b-abe45ffe638f {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:19:52.363810 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-45ebfd18-2fa9-4177-8961-cb47626fab54 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:52.372354 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-45ebfd18-2fa9-4177-8961-cb47626fab54 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 200 len: 1332 microversion: 2.1 time: 0.097617 Jul 25 12:19:52.372912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 352/695] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:52 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:19:53.393217 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1ffd3986-6e7d-4595-9614-91c8b73f3a78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:53.393920 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1ffd3986-6e7d-4595-9614-91c8b73f3a78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:53.400707 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ffd3986-6e7d-4595-9614-91c8b73f3a78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:53.401156 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ffd3986-6e7d-4595-9614-91c8b73f3a78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:53.401921 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ffd3986-6e7d-4595-9614-91c8b73f3a78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:53.402357 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1ffd3986-6e7d-4595-9614-91c8b73f3a78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:53.416725 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-1ffd3986-6e7d-4595-9614-91c8b73f3a78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1ffd3986-6e7d-4595-9614-91c8b73f3a78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f HTTP/1.1 Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:19:53.418413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:19:53.419976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:19:53.419976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:19:53.419976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:19:53.419976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:19:53.419976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:19:53.419976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:19:53.419976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:19:53.419976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:19:53.419976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:19:53.419976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:19:53.419976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:19:53.419976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': '6cf2bada-8518-4f83-8d6b-abe45ffe638f'} Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:19:53.420882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:19:53.422349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:53.423713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1ffd3986-6e7d-4595-9614-91c8b73f3a78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 404 to user: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:19:53.423713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1ffd3986-6e7d-4595-9614-91c8b73f3a78 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 404 len: 111 microversion: 2.1 time: 0.030769 Jul 25 12:19:53.423713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 344/696] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:53 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:19:53.428874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0eeec0f3-0264-407d-8b1d-5628f9310462 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '.version_select at 0x7f942c33dee0>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:53.448283 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0eeec0f3-0264-407d-8b1d-5628f9310462 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393590036" status: 202 len: 0 microversion: 2.1 time: 0.023103 Jul 25 12:19:53.448889 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 353/697] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Jul 25 12:19:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393590036 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:19:54.049966 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2fd86ce5-3839-4a64-858c-c6f733a1a5c3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Action: 'create', calling method: .version_select at 0x7f942c403d30>, body: {"keypair": {"name": "tempest-keypair-834412666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG1xg6VcCIQrGu+vcjeyGX32iv3wkjdMISMefr19UsPkML2bMqcbDzWYpC97lFkvV8x/ya2YvjcLYeaiGOyM30Hkurqh37RUpleLisxEzhPvNq7QgOcBdPtkJbSnureJw=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:54.065108 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-2fd86ce5-3839-4a64-858c-c6f733a1a5c3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:19:54.068931 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-2fd86ce5-3839-4a64-858c-c6f733a1a5c3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for user 3848eae5b8df48eb9816ba0d7485f7c0 and project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:19:54.091274 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2fd86ce5-3839-4a64-858c-c6f733a1a5c3 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045195 Jul 25 12:19:54.092224 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 345/698] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Jul 25 12:19:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:19:54.224841 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0a735a3e-9d23-4b6e-87bb-ec8a9474df48 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:54.225488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0a735a3e-9d23-4b6e-87bb-ec8a9474df48 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:54.232506 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a735a3e-9d23-4b6e-87bb-ec8a9474df48 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:54.233310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a735a3e-9d23-4b6e-87bb-ec8a9474df48 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:54.234769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a735a3e-9d23-4b6e-87bb-ec8a9474df48 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:54.235867 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0a735a3e-9d23-4b6e-87bb-ec8a9474df48 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:54.267268 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0a735a3e-9d23-4b6e-87bb-ec8a9474df48 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:19:54.346070 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0a735a3e-9d23-4b6e-87bb-ec8a9474df48 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 204 len: 0 microversion: 2.1 time: 0.125658 Jul 25 12:19:54.346706 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 354/699] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:19:54 2022] DELETE /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:19:54.355240 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b65032d4-016e-4381-a8af-7c9f61e3a8e6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:54.355882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b65032d4-016e-4381-a8af-7c9f61e3a8e6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:54.362566 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b65032d4-016e-4381-a8af-7c9f61e3a8e6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:54.363024 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b65032d4-016e-4381-a8af-7c9f61e3a8e6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:54.363845 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b65032d4-016e-4381-a8af-7c9f61e3a8e6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:54.364284 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b65032d4-016e-4381-a8af-7c9f61e3a8e6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:54.562467 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b65032d4-016e-4381-a8af-7c9f61e3a8e6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:54.570429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b65032d4-016e-4381-a8af-7c9f61e3a8e6 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1508 microversion: 2.1 time: 0.219245 Jul 25 12:19:54.571174 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 346/700] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:54 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:55.434732 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1326510469", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6bc64d3-b55c-4e64-a050-b439cd834684"}], "security_groups": [{"name": "tempest-securitygroup--143657654"}], "key_name": "tempest-keypair-834412666", "user_data": "}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:55.537091 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] validate_networks() for [('b6bc64d3-b55c-4e64-a050-b439cd834684', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:19:55.591576 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-901f3e5c-c0dd-46c2-8423-4c91203276c5 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:55.592303 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-901f3e5c-c0dd-46c2-8423-4c91203276c5 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:55.598702 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-901f3e5c-c0dd-46c2-8423-4c91203276c5 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:55.599140 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-901f3e5c-c0dd-46c2-8423-4c91203276c5 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:55.599921 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-901f3e5c-c0dd-46c2-8423-4c91203276c5 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:55.600348 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-901f3e5c-c0dd-46c2-8423-4c91203276c5 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:55.737815 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-901f3e5c-c0dd-46c2-8423-4c91203276c5 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:55.745556 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-901f3e5c-c0dd-46c2-8423-4c91203276c5 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1508 microversion: 2.1 time: 0.158310 Jul 25 12:19:55.746120 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 347/701] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:55 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:19:55.903918 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:19:55.904347 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:19:55.904830 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:19:55.905240 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:19:55.905650 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:19:55.914330 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:55.914775 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:55.915609 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:55.916051 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:55.932274 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:19:55.936220 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Getting quotas for user 3848eae5b8df48eb9816ba0d7485f7c0 and project 11ff6cbb1ad04f0faa8b2ed2a66cdca4. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:19:55.947517 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:19:55.949872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:19:55.996142 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3ac7c5d8-be60-4c32-b2a1-449d6a1bcc98 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.566042 Jul 25 12:19:55.996759 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 355/702] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:19:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:19:56.007466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6fa274cb-c88c-4b8f-98ca-39e6661c5a04 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:56.008096 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6fa274cb-c88c-4b8f-98ca-39e6661c5a04 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:56.061323 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6fa274cb-c88c-4b8f-98ca-39e6661c5a04 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:56.067853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6fa274cb-c88c-4b8f-98ca-39e6661c5a04 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1241 microversion: 2.1 time: 0.064061 Jul 25 12:19:56.068338 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 348/703] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:56 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:56.766553 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e71e3323-9e42-4dd6-8beb-3c1f382ac64c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:56.767155 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e71e3323-9e42-4dd6-8beb-3c1f382ac64c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:56.773447 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e71e3323-9e42-4dd6-8beb-3c1f382ac64c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:56.773896 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e71e3323-9e42-4dd6-8beb-3c1f382ac64c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:56.774688 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e71e3323-9e42-4dd6-8beb-3c1f382ac64c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:56.775672 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e71e3323-9e42-4dd6-8beb-3c1f382ac64c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:56.907668 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-287f094d-2348-497a-984d-cbaf38aee0ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:56.908886 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-287f094d-2348-497a-984d-cbaf38aee0ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:56.916615 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-287f094d-2348-497a-984d-cbaf38aee0ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:56.917067 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-287f094d-2348-497a-984d-cbaf38aee0ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:56.917834 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-287f094d-2348-497a-984d-cbaf38aee0ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:56.918268 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-287f094d-2348-497a-984d-cbaf38aee0ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:56.932828 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:56.944478 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-287f094d-2348-497a-984d-cbaf38aee0ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/ips" status: 200 len: 151 microversion: 2.20 time: 0.164160 Jul 25 12:19:56.945036 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 349/704] 10.222.0.42 () {60 vars in 1289 bytes} [Mon Jul 25 12:19:56 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/ips => generated 151 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:19:56.956329 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e71e3323-9e42-4dd6-8beb-3c1f382ac64c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:56.964471 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e71e3323-9e42-4dd6-8beb-3c1f382ac64c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1508 microversion: 2.1 time: 0.202226 Jul 25 12:19:56.965117 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 356/705] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:56 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:57.144864 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-805e0e85-b62b-42c4-b359-51b3ed9f0b4a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:57.145682 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-805e0e85-b62b-42c4-b359-51b3ed9f0b4a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:57.153361 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-805e0e85-b62b-42c4-b359-51b3ed9f0b4a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:57.154002 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-805e0e85-b62b-42c4-b359-51b3ed9f0b4a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:57.155029 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-805e0e85-b62b-42c4-b359-51b3ed9f0b4a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:57.155645 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-805e0e85-b62b-42c4-b359-51b3ed9f0b4a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:57.265899 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-805e0e85-b62b-42c4-b359-51b3ed9f0b4a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:57.274137 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-805e0e85-b62b-42c4-b359-51b3ed9f0b4a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1293 microversion: 2.1 time: 0.189089 Jul 25 12:19:57.274798 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 350/706] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:57 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1293 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:57.879668 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-8926d60e-ee7f-4046-af37-d365243a3bde req-9e67fff5-2fa0-41d8-ac9b-44a7ca2f2120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca94ee8-647e-426e-a219-a1bb3cf33deb", "name": "network-vif-deleted", "tag": "7f197314-d0da-4b94-8f2d-39d9013c44e2"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:57.900328 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-8926d60e-ee7f-4046-af37-d365243a3bde req-9e67fff5-2fa0-41d8-ac9b-44a7ca2f2120 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:57.903946 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-8926d60e-ee7f-4046-af37-d365243a3bde req-9e67fff5-2fa0-41d8-ac9b-44a7ca2f2120 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:57.923801 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-8926d60e-ee7f-4046-af37-d365243a3bde req-9e67fff5-2fa0-41d8-ac9b-44a7ca2f2120 service nova] Creating event network-vif-deleted:7f197314-d0da-4b94-8f2d-39d9013c44e2 for instance eca94ee8-647e-426e-a219-a1bb3cf33deb on hv-cinder-79760 Jul 25 12:19:57.929156 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-8926d60e-ee7f-4046-af37-d365243a3bde req-9e67fff5-2fa0-41d8-ac9b-44a7ca2f2120 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055552 Jul 25 12:19:57.930177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 357/707] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:19:57.985844 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-54f959d3-7861-44df-be78-4a3df089c201 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:57.987785 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-54f959d3-7861-44df-be78-4a3df089c201 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:57.996625 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54f959d3-7861-44df-be78-4a3df089c201 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:57.997087 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54f959d3-7861-44df-be78-4a3df089c201 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:57.997862 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54f959d3-7861-44df-be78-4a3df089c201 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:57.998301 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54f959d3-7861-44df-be78-4a3df089c201 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:58.031988 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54f959d3-7861-44df-be78-4a3df089c201 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:58.032345 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-54f959d3-7861-44df-be78-4a3df089c201 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:58.032795 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-54f959d3-7861-44df-be78-4a3df089c201 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lazy-loading 'fault' on Instance uuid eca94ee8-647e-426e-a219-a1bb3cf33deb {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:19:58.087851 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-54f959d3-7861-44df-be78-4a3df089c201 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:58.095932 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-54f959d3-7861-44df-be78-4a3df089c201 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 200 len: 1312 microversion: 2.1 time: 0.113917 Jul 25 12:19:58.096498 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 351/708] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:57 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:58.298471 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-31527f08-3b84-42d8-aeff-9831f07b20d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:58.299265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-31527f08-3b84-42d8-aeff-9831f07b20d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:58.307575 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31527f08-3b84-42d8-aeff-9831f07b20d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:58.308474 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31527f08-3b84-42d8-aeff-9831f07b20d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:58.309495 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31527f08-3b84-42d8-aeff-9831f07b20d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:58.310233 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-31527f08-3b84-42d8-aeff-9831f07b20d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:58.486929 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-31527f08-3b84-42d8-aeff-9831f07b20d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:58.498712 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-31527f08-3b84-42d8-aeff-9831f07b20d8 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1366 microversion: 2.1 time: 0.204939 Jul 25 12:19:58.499296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 358/709] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:58 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:58.819695 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7857bdb8-ab15-41d6-9278-cd754793a5ee tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:58.820144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7857bdb8-ab15-41d6-9278-cd754793a5ee tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:58.826936 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7857bdb8-ab15-41d6-9278-cd754793a5ee tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:58.827377 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7857bdb8-ab15-41d6-9278-cd754793a5ee tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:58.828168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7857bdb8-ab15-41d6-9278-cd754793a5ee tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:58.828766 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7857bdb8-ab15-41d6-9278-cd754793a5ee tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:58.854295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-7857bdb8-ab15-41d6-9278-cd754793a5ee tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lazy-loading 'flavor' on Instance uuid 716acb40-a825-4b9b-a5f2-63d87980cf7a {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:19:59.060886 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7857bdb8-ab15-41d6-9278-cd754793a5ee tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "POST /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/action" status: 202 len: 0 microversion: 2.20 time: 0.245211 Jul 25 12:19:59.062314 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 352/710] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Jul 25 12:19:58 2022] POST /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:19:59.070908 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-68aca00b-1fe9-48bc-aef2-e6cb61f519d8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:59.072451 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-68aca00b-1fe9-48bc-aef2-e6cb61f519d8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:59.079684 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-68aca00b-1fe9-48bc-aef2-e6cb61f519d8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:59.080143 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-68aca00b-1fe9-48bc-aef2-e6cb61f519d8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:59.080927 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-68aca00b-1fe9-48bc-aef2-e6cb61f519d8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:59.081437 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-68aca00b-1fe9-48bc-aef2-e6cb61f519d8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:59.117855 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b94b8fea-e80b-411a-bed7-44c30df68c8f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:59.118565 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b94b8fea-e80b-411a-bed7-44c30df68c8f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: eca94ee8-647e-426e-a219-a1bb3cf33deb] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:59.125958 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b94b8fea-e80b-411a-bed7-44c30df68c8f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:59.126407 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b94b8fea-e80b-411a-bed7-44c30df68c8f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:59.127178 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b94b8fea-e80b-411a-bed7-44c30df68c8f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:59.127850 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b94b8fea-e80b-411a-bed7-44c30df68c8f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:59.145280 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-b94b8fea-e80b-411a-bed7-44c30df68c8f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] HTTP exception thrown: Instance eca94ee8-647e-426e-a219-a1bb3cf33deb could not be found. Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b94b8fea-e80b-411a-bed7-44c30df68c8f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Request method failure captured: Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb HTTP/1.1 Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3ok95f1--OwMYyUO5AGbD5Z4dHg-jMGrNWEmk2P6lT01K8JUrcVV0YVdqEq8o-tTjrUfy5Y7jIVtvlBCIfFf8Cgi4_T5AOp8BBkuL66TB06rqEy43oBVdOKCQsvoVboB9KLGYCm0UW4LDW9mxQW3-OyhTABwIATZuCV3W1wPXNw5dA0 Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 2d9f339447114912b0c92b99e028fbbf Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:19:59.146968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:19:59.148536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:19:59.148536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:19:59.148536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 2d9f339447114912b0c92b99e028fbbf Jul 25 12:19:59.148536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:19:59.148536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-ServerRescueNegativeTestJSON-1430226500-project Jul 25 12:19:59.148536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:19:59.148536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:19:59.148536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: a766d17b116f498fab07efb69c94e49e Jul 25 12:19:59.148536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1430226500-project Jul 25 12:19:59.148536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:19:59.148536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance eca94ee8-647e-426e-a219-a1bb3cf33deb could not be found. Jul 25 12:19:59.148536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': 'eca94ee8-647e-426e-a219-a1bb3cf33deb'} Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca94ee8-647e-426e-a219-a1bb3cf33deb could not be found. Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:19:59.149439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca94ee8-647e-426e-a219-a1bb3cf33deb could not be found. Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca94ee8-647e-426e-a219-a1bb3cf33deb could not be found. Jul 25 12:19:59.150876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:19:59.152186 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b94b8fea-e80b-411a-bed7-44c30df68c8f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Returning 404 to user: Instance eca94ee8-647e-426e-a219-a1bb3cf33deb could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:19:59.152186 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b94b8fea-e80b-411a-bed7-44c30df68c8f tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb" status: 404 len: 111 microversion: 2.1 time: 0.034789 Jul 25 12:19:59.152186 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 353/711] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:59 2022] GET /compute/v2.1/servers/eca94ee8-647e-426e-a219-a1bb3cf33deb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:19:59.160852 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e239608b-fcd5-452d-a0dd-85bd4592f990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:59.161354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e239608b-fcd5-452d-a0dd-85bd4592f990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:59.168340 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e239608b-fcd5-452d-a0dd-85bd4592f990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:59.168788 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e239608b-fcd5-452d-a0dd-85bd4592f990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:59.170743 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e239608b-fcd5-452d-a0dd-85bd4592f990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:59.170743 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e239608b-fcd5-452d-a0dd-85bd4592f990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:59.199349 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e239608b-fcd5-452d-a0dd-85bd4592f990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:19:59.247994 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-68aca00b-1fe9-48bc-aef2-e6cb61f519d8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:59.255995 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-68aca00b-1fe9-48bc-aef2-e6cb61f519d8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:59.257631 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-68aca00b-1fe9-48bc-aef2-e6cb61f519d8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:59.258718 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-68aca00b-1fe9-48bc-aef2-e6cb61f519d8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.191925 Jul 25 12:19:59.259930 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 359/712] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:19:59 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:19:59.294052 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e239608b-fcd5-452d-a0dd-85bd4592f990 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 204 len: 0 microversion: 2.1 time: 0.136749 Jul 25 12:19:59.294667 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 354/713] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:19:59 2022] DELETE /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:19:59.302508 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8c1a70cc-6bf3-4927-8fba-cea471d5bdfa tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:59.303109 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8c1a70cc-6bf3-4927-8fba-cea471d5bdfa tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:59.309586 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8c1a70cc-6bf3-4927-8fba-cea471d5bdfa tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:59.310029 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8c1a70cc-6bf3-4927-8fba-cea471d5bdfa tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:59.310784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8c1a70cc-6bf3-4927-8fba-cea471d5bdfa tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:59.311213 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8c1a70cc-6bf3-4927-8fba-cea471d5bdfa tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:59.453134 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8c1a70cc-6bf3-4927-8fba-cea471d5bdfa tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:59.461556 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8c1a70cc-6bf3-4927-8fba-cea471d5bdfa tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.162651 Jul 25 12:19:59.462761 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 360/714] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:59 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:59.520441 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3e9c795c-a81e-4130-ad3b-ad9e70712e5d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:19:59.521146 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3e9c795c-a81e-4130-ad3b-ad9e70712e5d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:19:59.527223 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e9c795c-a81e-4130-ad3b-ad9e70712e5d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:59.527946 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e9c795c-a81e-4130-ad3b-ad9e70712e5d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:59.528705 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e9c795c-a81e-4130-ad3b-ad9e70712e5d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:59.529137 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3e9c795c-a81e-4130-ad3b-ad9e70712e5d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:59.656376 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3e9c795c-a81e-4130-ad3b-ad9e70712e5d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:19:59.663815 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3e9c795c-a81e-4130-ad3b-ad9e70712e5d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1366 microversion: 2.1 time: 0.147635 Jul 25 12:19:59.664377 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 355/715] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:19:59 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:19:59.971602 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-0703ce08-ca84-4c6a-9bee-c25de2b2477e req-550f294d-8840-4afb-a197-83a5b2bc131e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c6ab49-d845-4c1d-80ce-32c24c25ed6d", "tag": "276cabbe-91f0-4792-85c7-8ae931f21975"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:19:59.981745 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-0703ce08-ca84-4c6a-9bee-c25de2b2477e req-550f294d-8840-4afb-a197-83a5b2bc131e service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:19:59.982185 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-0703ce08-ca84-4c6a-9bee-c25de2b2477e req-550f294d-8840-4afb-a197-83a5b2bc131e service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:19:59.992875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-0703ce08-ca84-4c6a-9bee-c25de2b2477e req-550f294d-8840-4afb-a197-83a5b2bc131e service nova] Creating event network-changed:276cabbe-91f0-4792-85c7-8ae931f21975 for instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d on hv-cinder-79760 Jul 25 12:19:59.997574 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-0703ce08-ca84-4c6a-9bee-c25de2b2477e req-550f294d-8840-4afb-a197-83a5b2bc131e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029732 Jul 25 12:19:59.998129 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 361/716] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:00.283347 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-2809de41-85c5-4c97-848f-7094af37016c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:00.283936 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-2809de41-85c5-4c97-848f-7094af37016c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:00.290627 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2809de41-85c5-4c97-848f-7094af37016c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:00.291078 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2809de41-85c5-4c97-848f-7094af37016c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:00.291868 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2809de41-85c5-4c97-848f-7094af37016c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:00.292301 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-2809de41-85c5-4c97-848f-7094af37016c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:00.419151 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2809de41-85c5-4c97-848f-7094af37016c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:00.427025 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2809de41-85c5-4c97-848f-7094af37016c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:00.428564 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-2809de41-85c5-4c97-848f-7094af37016c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:00.429716 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-2809de41-85c5-4c97-848f-7094af37016c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.150369 Jul 25 12:20:00.430271 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 356/717] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:00 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:00.482934 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6406358f-3307-4d93-8f8c-a7bb4175767e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:00.483676 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6406358f-3307-4d93-8f8c-a7bb4175767e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:00.489745 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6406358f-3307-4d93-8f8c-a7bb4175767e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:00.490185 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6406358f-3307-4d93-8f8c-a7bb4175767e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:00.490925 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6406358f-3307-4d93-8f8c-a7bb4175767e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:00.491353 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6406358f-3307-4d93-8f8c-a7bb4175767e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:00.620112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6406358f-3307-4d93-8f8c-a7bb4175767e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:00.627537 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6406358f-3307-4d93-8f8c-a7bb4175767e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.149154 Jul 25 12:20:00.628116 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 362/718] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:00 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:20:00.685310 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-472c7051-d7c8-43b9-8281-783caadbfd6d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:00.685909 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-472c7051-d7c8-43b9-8281-783caadbfd6d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:00.691944 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-472c7051-d7c8-43b9-8281-783caadbfd6d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:00.692393 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-472c7051-d7c8-43b9-8281-783caadbfd6d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:00.693152 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-472c7051-d7c8-43b9-8281-783caadbfd6d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:00.693584 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-472c7051-d7c8-43b9-8281-783caadbfd6d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:00.823373 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-472c7051-d7c8-43b9-8281-783caadbfd6d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:00.830640 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-472c7051-d7c8-43b9-8281-783caadbfd6d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1366 microversion: 2.1 time: 0.149626 Jul 25 12:20:00.831200 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 357/719] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:00 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:20:01.453323 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-57035219-0eed-4dea-bbac-2e94245efc43 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:01.453925 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-57035219-0eed-4dea-bbac-2e94245efc43 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:01.459941 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57035219-0eed-4dea-bbac-2e94245efc43 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:01.460417 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57035219-0eed-4dea-bbac-2e94245efc43 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:01.461173 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57035219-0eed-4dea-bbac-2e94245efc43 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:01.461603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-57035219-0eed-4dea-bbac-2e94245efc43 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:01.592178 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-57035219-0eed-4dea-bbac-2e94245efc43 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:01.600072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-57035219-0eed-4dea-bbac-2e94245efc43 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:01.601580 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-57035219-0eed-4dea-bbac-2e94245efc43 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:01.602735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-57035219-0eed-4dea-bbac-2e94245efc43 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.153338 Jul 25 12:20:01.603988 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 363/720] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:01 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:01.648634 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bc65315e-8065-4571-a9cb-6e20ab49bee2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:01.649272 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bc65315e-8065-4571-a9cb-6e20ab49bee2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:01.656630 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc65315e-8065-4571-a9cb-6e20ab49bee2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:01.657116 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc65315e-8065-4571-a9cb-6e20ab49bee2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:01.657871 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc65315e-8065-4571-a9cb-6e20ab49bee2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:01.658302 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bc65315e-8065-4571-a9cb-6e20ab49bee2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:01.785935 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bc65315e-8065-4571-a9cb-6e20ab49bee2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:01.793312 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bc65315e-8065-4571-a9cb-6e20ab49bee2 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.148483 Jul 25 12:20:01.793873 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 358/721] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:01 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:20:01.850043 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-466f472e-13bb-4732-906a-23b7c3a3b097 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:01.850655 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-466f472e-13bb-4732-906a-23b7c3a3b097 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:01.856723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-466f472e-13bb-4732-906a-23b7c3a3b097 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:01.857177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-466f472e-13bb-4732-906a-23b7c3a3b097 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:01.857936 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-466f472e-13bb-4732-906a-23b7c3a3b097 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:01.858373 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-466f472e-13bb-4732-906a-23b7c3a3b097 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:01.982025 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-466f472e-13bb-4732-906a-23b7c3a3b097 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:01.989672 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-466f472e-13bb-4732-906a-23b7c3a3b097 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1366 microversion: 2.1 time: 0.143371 Jul 25 12:20:01.990178 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 364/722] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:01 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:20:02.626594 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0087f6e1-6c70-4011-9717-1d753c5c1744 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:02.627197 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0087f6e1-6c70-4011-9717-1d753c5c1744 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:02.633230 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0087f6e1-6c70-4011-9717-1d753c5c1744 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:02.633673 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0087f6e1-6c70-4011-9717-1d753c5c1744 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:02.634436 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0087f6e1-6c70-4011-9717-1d753c5c1744 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:02.634863 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0087f6e1-6c70-4011-9717-1d753c5c1744 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:02.814177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2c246da2-5e80-44e0-80ee-7766affb1c6c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:02.814896 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2c246da2-5e80-44e0-80ee-7766affb1c6c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:02.821748 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c246da2-5e80-44e0-80ee-7766affb1c6c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:02.822316 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c246da2-5e80-44e0-80ee-7766affb1c6c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:02.823114 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c246da2-5e80-44e0-80ee-7766affb1c6c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:02.823584 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2c246da2-5e80-44e0-80ee-7766affb1c6c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:02.955317 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2c246da2-5e80-44e0-80ee-7766affb1c6c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:02.963784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2c246da2-5e80-44e0-80ee-7766affb1c6c tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1522 microversion: 2.1 time: 0.153388 Jul 25 12:20:02.964344 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 365/723] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:02 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:20:02.972204 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0087f6e1-6c70-4011-9717-1d753c5c1744 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:02.981399 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0087f6e1-6c70-4011-9717-1d753c5c1744 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:02.982881 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0087f6e1-6c70-4011-9717-1d753c5c1744 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:02.984066 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0087f6e1-6c70-4011-9717-1d753c5c1744 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.361393 Jul 25 12:20:02.984608 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 359/724] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:02 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:03.010069 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0b3d307b-ed49-4798-a0ae-bfe7e569aec1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:03.010668 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0b3d307b-ed49-4798-a0ae-bfe7e569aec1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:03.016547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b3d307b-ed49-4798-a0ae-bfe7e569aec1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:03.016988 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b3d307b-ed49-4798-a0ae-bfe7e569aec1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:03.017741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b3d307b-ed49-4798-a0ae-bfe7e569aec1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:03.018164 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0b3d307b-ed49-4798-a0ae-bfe7e569aec1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:03.145360 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0b3d307b-ed49-4798-a0ae-bfe7e569aec1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:03.153768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0b3d307b-ed49-4798-a0ae-bfe7e569aec1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1366 microversion: 2.1 time: 0.147465 Jul 25 12:20:03.154377 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 366/725] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:03 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:20:03.542202 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-51dc68a2-a754-408c-8bd1-84ff7a0dd5f9 req-4b4604a0-06d4-4d17-8887-d380a286b4ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9644e94-ac1d-497c-868e-36945ba75fa6", "name": "network-vif-deleted", "tag": "c8918714-06f3-4c5f-bc49-913ec7c6960a"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:20:03.551766 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-51dc68a2-a754-408c-8bd1-84ff7a0dd5f9 req-4b4604a0-06d4-4d17-8887-d380a286b4ee service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:03.552210 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-51dc68a2-a754-408c-8bd1-84ff7a0dd5f9 req-4b4604a0-06d4-4d17-8887-d380a286b4ee service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:03.563564 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-51dc68a2-a754-408c-8bd1-84ff7a0dd5f9 req-4b4604a0-06d4-4d17-8887-d380a286b4ee service nova] Creating event network-vif-deleted:c8918714-06f3-4c5f-bc49-913ec7c6960a for instance c9644e94-ac1d-497c-868e-36945ba75fa6 on hv-cinder-79760 Jul 25 12:20:03.568225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-51dc68a2-a754-408c-8bd1-84ff7a0dd5f9 req-4b4604a0-06d4-4d17-8887-d380a286b4ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029717 Jul 25 12:20:03.568786 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 360/726] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:03.984848 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5ae26c43-7a2a-4c23-8dbc-774c04dc6d9e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:03.985449 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5ae26c43-7a2a-4c23-8dbc-774c04dc6d9e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:03.991912 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ae26c43-7a2a-4c23-8dbc-774c04dc6d9e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:03.992357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ae26c43-7a2a-4c23-8dbc-774c04dc6d9e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:03.993103 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ae26c43-7a2a-4c23-8dbc-774c04dc6d9e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:03.994295 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5ae26c43-7a2a-4c23-8dbc-774c04dc6d9e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:04.008710 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3aef4619-c6d5-43a8-9fce-4c6b86b87f7d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:04.009463 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3aef4619-c6d5-43a8-9fce-4c6b86b87f7d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:04.015557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3aef4619-c6d5-43a8-9fce-4c6b86b87f7d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:04.016013 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3aef4619-c6d5-43a8-9fce-4c6b86b87f7d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:04.016773 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3aef4619-c6d5-43a8-9fce-4c6b86b87f7d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:04.017202 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3aef4619-c6d5-43a8-9fce-4c6b86b87f7d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:04.054902 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5ae26c43-7a2a-4c23-8dbc-774c04dc6d9e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a766d17b116f498fab07efb69c94e49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9f339447114912b0c92b99e028fbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:04.063376 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5ae26c43-7a2a-4c23-8dbc-774c04dc6d9e tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 200 len: 1480 microversion: 2.1 time: 0.082360 Jul 25 12:20:04.063987 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 367/727] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:03 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 1480 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:20:04.144270 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3aef4619-c6d5-43a8-9fce-4c6b86b87f7d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:04.152074 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3aef4619-c6d5-43a8-9fce-4c6b86b87f7d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:04.153837 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3aef4619-c6d5-43a8-9fce-4c6b86b87f7d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:04.154991 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3aef4619-c6d5-43a8-9fce-4c6b86b87f7d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.150989 Jul 25 12:20:04.155562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 361/728] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:04 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:20:04.174040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-95313abe-073b-44eb-a66b-25733e91e682 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:04.174681 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-95313abe-073b-44eb-a66b-25733e91e682 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:04.180720 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95313abe-073b-44eb-a66b-25733e91e682 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:04.181735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95313abe-073b-44eb-a66b-25733e91e682 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:04.182461 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95313abe-073b-44eb-a66b-25733e91e682 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:04.182891 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95313abe-073b-44eb-a66b-25733e91e682 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:04.316768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-95313abe-073b-44eb-a66b-25733e91e682 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:04.319192 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:04.326531 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-95313abe-073b-44eb-a66b-25733e91e682 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1366 microversion: 2.1 time: 0.156216 Jul 25 12:20:04.327112 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 368/729] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:04 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:20:05.084830 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e79b85d9-47f6-4b05-a813-377a1bae3049 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:05.085433 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e79b85d9-47f6-4b05-a813-377a1bae3049 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] [instance: c9644e94-ac1d-497c-868e-36945ba75fa6] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:05.091922 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e79b85d9-47f6-4b05-a813-377a1bae3049 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:05.092364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e79b85d9-47f6-4b05-a813-377a1bae3049 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:05.093110 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e79b85d9-47f6-4b05-a813-377a1bae3049 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:05.093535 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e79b85d9-47f6-4b05-a813-377a1bae3049 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:05.106545 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-e79b85d9-47f6-4b05-a813-377a1bae3049 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] HTTP exception thrown: Instance c9644e94-ac1d-497c-868e-36945ba75fa6 could not be found. Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e79b85d9-47f6-4b05-a813-377a1bae3049 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Request method failure captured: Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 HTTP/1.1 Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3ok95f1--OwMYyUO5AGbD5Z4dHg-jMGrNWEmk2P6lT01K8JUrcVV0YVdqEq8o-tTjrUfy5Y7jIVtvlBCIfFf8Cgi4_T5AOp8BBkuL66TB06rqEy43oBVdOKCQsvoVboB9KLGYCm0UW4LDW9mxQW3-OyhTABwIATZuCV3W1wPXNw5dA0 Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 2d9f339447114912b0c92b99e028fbbf Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:20:05.108184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:20:05.109754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2d9f339447114912b0c92b99e028fbbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:20:05.109754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:20:05.109754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 2d9f339447114912b0c92b99e028fbbf Jul 25 12:20:05.109754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1430226500 Jul 25 12:20:05.109754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-ServerRescueNegativeTestJSON-1430226500-project Jul 25 12:20:05.109754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:20:05.109754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:20:05.109754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: a766d17b116f498fab07efb69c94e49e Jul 25 12:20:05.109754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1430226500-project Jul 25 12:20:05.109754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:20:05.109754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance c9644e94-ac1d-497c-868e-36945ba75fa6 could not be found. Jul 25 12:20:05.109754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': 'c9644e94-ac1d-497c-868e-36945ba75fa6'} Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9644e94-ac1d-497c-868e-36945ba75fa6 could not be found. Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:20:05.110562 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9644e94-ac1d-497c-868e-36945ba75fa6 could not be found. Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9644e94-ac1d-497c-868e-36945ba75fa6 could not be found. Jul 25 12:20:05.111998 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:05.113249 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e79b85d9-47f6-4b05-a813-377a1bae3049 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] Returning 404 to user: Instance c9644e94-ac1d-497c-868e-36945ba75fa6 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:20:05.113249 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e79b85d9-47f6-4b05-a813-377a1bae3049 tempest-ServerRescueNegativeTestJSON-1430226500 tempest-ServerRescueNegativeTestJSON-1430226500-project] 10.222.0.42 "GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6" status: 404 len: 111 microversion: 2.1 time: 0.028539 Jul 25 12:20:05.113249 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 362/730] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:05 2022] GET /compute/v2.1/servers/c9644e94-ac1d-497c-868e-36945ba75fa6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:20:05.178769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cb74714a-d9ac-4b9a-b374-79e96d8b370a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:05.179458 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cb74714a-d9ac-4b9a-b374-79e96d8b370a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:05.187902 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb74714a-d9ac-4b9a-b374-79e96d8b370a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:05.188352 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb74714a-d9ac-4b9a-b374-79e96d8b370a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:05.189110 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb74714a-d9ac-4b9a-b374-79e96d8b370a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:05.189542 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cb74714a-d9ac-4b9a-b374-79e96d8b370a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:05.348067 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-52ae14c4-2302-418e-99b2-cb037f1ee4cd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:05.348591 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-52ae14c4-2302-418e-99b2-cb037f1ee4cd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:05.355115 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52ae14c4-2302-418e-99b2-cb037f1ee4cd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:05.355583 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52ae14c4-2302-418e-99b2-cb037f1ee4cd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:05.356351 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52ae14c4-2302-418e-99b2-cb037f1ee4cd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:05.356794 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52ae14c4-2302-418e-99b2-cb037f1ee4cd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:05.401949 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cb74714a-d9ac-4b9a-b374-79e96d8b370a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:05.412350 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cb74714a-d9ac-4b9a-b374-79e96d8b370a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:05.414159 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cb74714a-d9ac-4b9a-b374-79e96d8b370a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:05.416261 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cb74714a-d9ac-4b9a-b374-79e96d8b370a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.240515 Jul 25 12:20:05.419237 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 369/731] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:05 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:05.494629 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-52ae14c4-2302-418e-99b2-cb037f1ee4cd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:05.501887 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-52ae14c4-2302-418e-99b2-cb037f1ee4cd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1366 microversion: 2.1 time: 0.157858 Jul 25 12:20:05.502439 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 363/732] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:05 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:20:06.440062 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-21afe5c5-636c-4917-940c-f90d7ac34641 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:06.440582 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-21afe5c5-636c-4917-940c-f90d7ac34641 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:06.445456 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:06.446176 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:06.448812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21afe5c5-636c-4917-940c-f90d7ac34641 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:06.449264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21afe5c5-636c-4917-940c-f90d7ac34641 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:06.450100 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21afe5c5-636c-4917-940c-f90d7ac34641 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:06.450559 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-21afe5c5-636c-4917-940c-f90d7ac34641 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:06.522472 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b2de931d-9f05-4d85-8916-97fdb0825f5a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:06.523089 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b2de931d-9f05-4d85-8916-97fdb0825f5a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:06.525327 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:06.531443 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2de931d-9f05-4d85-8916-97fdb0825f5a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:06.531912 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2de931d-9f05-4d85-8916-97fdb0825f5a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:06.532679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2de931d-9f05-4d85-8916-97fdb0825f5a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:06.533100 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b2de931d-9f05-4d85-8916-97fdb0825f5a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:06.548679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:06.672666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b2de931d-9f05-4d85-8916-97fdb0825f5a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:06.697899 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b2de931d-9f05-4d85-8916-97fdb0825f5a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1366 microversion: 2.1 time: 0.179130 Jul 25 12:20:06.698510 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 364/733] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:06 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:20:06.872599 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-21afe5c5-636c-4917-940c-f90d7ac34641 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:06.880721 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-21afe5c5-636c-4917-940c-f90d7ac34641 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:06.882222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-21afe5c5-636c-4917-940c-f90d7ac34641 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:06.883391 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-21afe5c5-636c-4917-940c-f90d7ac34641 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.447553 Jul 25 12:20:06.883981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 370/734] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:06 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:20:07.719213 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-307058aa-523f-43ad-a5fe-8185b94d4480 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:07.719817 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-307058aa-523f-43ad-a5fe-8185b94d4480 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:07.725827 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-307058aa-523f-43ad-a5fe-8185b94d4480 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:07.726215 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-307058aa-523f-43ad-a5fe-8185b94d4480 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:07.726975 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-307058aa-523f-43ad-a5fe-8185b94d4480 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:07.727404 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-307058aa-523f-43ad-a5fe-8185b94d4480 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:07.877579 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-307058aa-523f-43ad-a5fe-8185b94d4480 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:07.885634 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-307058aa-523f-43ad-a5fe-8185b94d4480 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1366 microversion: 2.1 time: 0.170350 Jul 25 12:20:07.886199 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 365/735] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:07 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:20:07.906647 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5738c910-ead1-44c8-8f7f-c4c291165bd3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:07.907257 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5738c910-ead1-44c8-8f7f-c4c291165bd3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:07.914610 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5738c910-ead1-44c8-8f7f-c4c291165bd3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:07.915331 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5738c910-ead1-44c8-8f7f-c4c291165bd3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:07.916278 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5738c910-ead1-44c8-8f7f-c4c291165bd3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:07.916782 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5738c910-ead1-44c8-8f7f-c4c291165bd3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:08.078349 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5738c910-ead1-44c8-8f7f-c4c291165bd3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:08.086325 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5738c910-ead1-44c8-8f7f-c4c291165bd3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:08.088245 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5738c910-ead1-44c8-8f7f-c4c291165bd3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:08.089441 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5738c910-ead1-44c8-8f7f-c4c291165bd3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.186631 Jul 25 12:20:08.103827 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 371/736] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:07 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:08.906724 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fc91ae4f-bae7-41d3-83ce-657c3ecd82c9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:08.907328 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fc91ae4f-bae7-41d3-83ce-657c3ecd82c9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:08.913960 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc91ae4f-bae7-41d3-83ce-657c3ecd82c9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:08.914411 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc91ae4f-bae7-41d3-83ce-657c3ecd82c9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:08.915844 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc91ae4f-bae7-41d3-83ce-657c3ecd82c9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:08.916281 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc91ae4f-bae7-41d3-83ce-657c3ecd82c9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:09.061321 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-fc91ae4f-bae7-41d3-83ce-657c3ecd82c9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:09.071068 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fc91ae4f-bae7-41d3-83ce-657c3ecd82c9 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1366 microversion: 2.1 time: 0.168126 Jul 25 12:20:09.072917 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 366/737] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:08 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:20:09.118274 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9db398d3-96d2-44d4-b962-5ea96b8c3b89 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:09.119661 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9db398d3-96d2-44d4-b962-5ea96b8c3b89 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:09.126271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9db398d3-96d2-44d4-b962-5ea96b8c3b89 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:09.126730 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9db398d3-96d2-44d4-b962-5ea96b8c3b89 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:09.127881 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9db398d3-96d2-44d4-b962-5ea96b8c3b89 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:09.128490 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9db398d3-96d2-44d4-b962-5ea96b8c3b89 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:09.137167 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-d7acf2a7-e9e1-4f3f-a117-97b32b189e86 req-ff68946a-a61c-440f-a2c9-796ac4db8007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c6ab49-d845-4c1d-80ce-32c24c25ed6d", "name": "network-vif-plugged", "status": "completed", "tag": "276cabbe-91f0-4792-85c7-8ae931f21975"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:20:09.145321 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:09.147840 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-d7acf2a7-e9e1-4f3f-a117-97b32b189e86 req-ff68946a-a61c-440f-a2c9-796ac4db8007 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:09.148322 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-d7acf2a7-e9e1-4f3f-a117-97b32b189e86 req-ff68946a-a61c-440f-a2c9-796ac4db8007 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:09.163651 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-d7acf2a7-e9e1-4f3f-a117-97b32b189e86 req-ff68946a-a61c-440f-a2c9-796ac4db8007 service nova] Creating event network-vif-plugged:276cabbe-91f0-4792-85c7-8ae931f21975 for instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d on hv-cinder-79760 Jul 25 12:20:09.171828 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-d7acf2a7-e9e1-4f3f-a117-97b32b189e86 req-ff68946a-a61c-440f-a2c9-796ac4db8007 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043300 Jul 25 12:20:09.172994 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 367/738] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:20:09.291127 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9db398d3-96d2-44d4-b962-5ea96b8c3b89 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:09.300485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9db398d3-96d2-44d4-b962-5ea96b8c3b89 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:09.302079 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9db398d3-96d2-44d4-b962-5ea96b8c3b89 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:09.303469 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9db398d3-96d2-44d4-b962-5ea96b8c3b89 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.189216 Jul 25 12:20:09.304334 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 372/739] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:09 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:10.094219 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cc524a90-d1c9-4f31-aa98-a9bc0e4dec6c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:10.094923 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cc524a90-d1c9-4f31-aa98-a9bc0e4dec6c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:10.101332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc524a90-d1c9-4f31-aa98-a9bc0e4dec6c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:10.101781 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc524a90-d1c9-4f31-aa98-a9bc0e4dec6c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:10.103065 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc524a90-d1c9-4f31-aa98-a9bc0e4dec6c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:10.103494 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc524a90-d1c9-4f31-aa98-a9bc0e4dec6c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:10.242192 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cc524a90-d1c9-4f31-aa98-a9bc0e4dec6c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:10.253634 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cc524a90-d1c9-4f31-aa98-a9bc0e4dec6c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1366 microversion: 2.1 time: 0.164522 Jul 25 12:20:10.254202 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 368/740] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:10 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:20:10.326878 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d1cc19a9-a247-44ab-9172-1f5e888a038a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:10.327486 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d1cc19a9-a247-44ab-9172-1f5e888a038a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:10.340171 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1cc19a9-a247-44ab-9172-1f5e888a038a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:10.340171 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1cc19a9-a247-44ab-9172-1f5e888a038a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:10.340171 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1cc19a9-a247-44ab-9172-1f5e888a038a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:10.340171 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1cc19a9-a247-44ab-9172-1f5e888a038a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:10.474196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d1cc19a9-a247-44ab-9172-1f5e888a038a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:10.483087 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d1cc19a9-a247-44ab-9172-1f5e888a038a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:10.484650 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d1cc19a9-a247-44ab-9172-1f5e888a038a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:10.486134 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d1cc19a9-a247-44ab-9172-1f5e888a038a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.163803 Jul 25 12:20:10.486691 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 373/741] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:10 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:11.274658 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6057b077-d087-4042-9bf3-757add4441bf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:11.286557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6057b077-d087-4042-9bf3-757add4441bf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:11.294055 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6057b077-d087-4042-9bf3-757add4441bf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:11.294510 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6057b077-d087-4042-9bf3-757add4441bf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:11.295290 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6057b077-d087-4042-9bf3-757add4441bf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:11.295755 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6057b077-d087-4042-9bf3-757add4441bf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:11.433977 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6057b077-d087-4042-9bf3-757add4441bf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:11.441399 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6057b077-d087-4042-9bf3-757add4441bf tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1557 microversion: 2.1 time: 0.170639 Jul 25 12:20:11.449651 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 369/742] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:11 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:20:11.461596 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7f238f20-59c3-4a78-8d0a-d5128652bbd1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:11.462165 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7f238f20-59c3-4a78-8d0a-d5128652bbd1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:11.468688 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f238f20-59c3-4a78-8d0a-d5128652bbd1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:11.469292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f238f20-59c3-4a78-8d0a-d5128652bbd1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:11.470127 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f238f20-59c3-4a78-8d0a-d5128652bbd1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:11.470747 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7f238f20-59c3-4a78-8d0a-d5128652bbd1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:11.512289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-455a8d35-f9fb-4c47-86c3-f498c99324c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:11.513080 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-455a8d35-f9fb-4c47-86c3-f498c99324c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:11.519309 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-455a8d35-f9fb-4c47-86c3-f498c99324c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:11.519861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-455a8d35-f9fb-4c47-86c3-f498c99324c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:11.520634 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-455a8d35-f9fb-4c47-86c3-f498c99324c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:11.521065 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-455a8d35-f9fb-4c47-86c3-f498c99324c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:11.553053 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7f238f20-59c3-4a78-8d0a-d5128652bbd1 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095150 Jul 25 12:20:11.553761 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 374/743] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Jul 25 12:20:11 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:11.786755 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-455a8d35-f9fb-4c47-86c3-f498c99324c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:11.796333 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-455a8d35-f9fb-4c47-86c3-f498c99324c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:11.797941 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-455a8d35-f9fb-4c47-86c3-f498c99324c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:11.799216 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-455a8d35-f9fb-4c47-86c3-f498c99324c0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.291294 Jul 25 12:20:11.799954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 370/744] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:11 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:20:12.809917 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-13c7f3f6-d8e8-492d-be3a-9ded7c0d9a72 req-017e4a8c-fb01-4ace-909d-09a4cdf4929a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c6ab49-d845-4c1d-80ce-32c24c25ed6d", "tag": "276cabbe-91f0-4792-85c7-8ae931f21975"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:20:12.820963 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-13c7f3f6-d8e8-492d-be3a-9ded7c0d9a72 req-017e4a8c-fb01-4ace-909d-09a4cdf4929a service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:12.821816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-13c7f3f6-d8e8-492d-be3a-9ded7c0d9a72 req-017e4a8c-fb01-4ace-909d-09a4cdf4929a service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:12.822909 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-92921757-169f-4ca4-b752-6bb213790095 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:12.824154 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-92921757-169f-4ca4-b752-6bb213790095 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:12.832052 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92921757-169f-4ca4-b752-6bb213790095 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:12.832755 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92921757-169f-4ca4-b752-6bb213790095 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:12.833741 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92921757-169f-4ca4-b752-6bb213790095 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:12.834359 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92921757-169f-4ca4-b752-6bb213790095 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:12.843439 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-13c7f3f6-d8e8-492d-be3a-9ded7c0d9a72 req-017e4a8c-fb01-4ace-909d-09a4cdf4929a service nova] Creating event network-changed:276cabbe-91f0-4792-85c7-8ae931f21975 for instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d on hv-cinder-79760 Jul 25 12:20:12.850743 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-13c7f3f6-d8e8-492d-be3a-9ded7c0d9a72 req-017e4a8c-fb01-4ace-909d-09a4cdf4929a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044994 Jul 25 12:20:12.852914 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 375/745] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:13.018690 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-92921757-169f-4ca4-b752-6bb213790095 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:13.029243 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-92921757-169f-4ca4-b752-6bb213790095 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:13.030730 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-92921757-169f-4ca4-b752-6bb213790095 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:13.032114 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-92921757-169f-4ca4-b752-6bb213790095 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.213179 Jul 25 12:20:13.033322 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 371/746] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:12 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:20:14.056601 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bc7a09ef-7b6b-48aa-a78c-9b6f955c2b96 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:14.057297 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bc7a09ef-7b6b-48aa-a78c-9b6f955c2b96 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:14.064086 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bc7a09ef-7b6b-48aa-a78c-9b6f955c2b96 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:14.064537 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bc7a09ef-7b6b-48aa-a78c-9b6f955c2b96 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:14.065297 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bc7a09ef-7b6b-48aa-a78c-9b6f955c2b96 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:14.065729 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bc7a09ef-7b6b-48aa-a78c-9b6f955c2b96 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:14.203412 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bc7a09ef-7b6b-48aa-a78c-9b6f955c2b96 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:14.211435 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bc7a09ef-7b6b-48aa-a78c-9b6f955c2b96 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:14.212943 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bc7a09ef-7b6b-48aa-a78c-9b6f955c2b96 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:14.214081 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bc7a09ef-7b6b-48aa-a78c-9b6f955c2b96 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.162305 Jul 25 12:20:14.214631 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 376/747] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:14 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:15.237283 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-062787ac-d0bc-4f8d-a638-d038107b814f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:15.237906 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-062787ac-d0bc-4f8d-a638-d038107b814f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:15.244385 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-062787ac-d0bc-4f8d-a638-d038107b814f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:15.244825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-062787ac-d0bc-4f8d-a638-d038107b814f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:15.245568 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-062787ac-d0bc-4f8d-a638-d038107b814f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:15.245990 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-062787ac-d0bc-4f8d-a638-d038107b814f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:15.375950 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-062787ac-d0bc-4f8d-a638-d038107b814f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:15.384259 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-062787ac-d0bc-4f8d-a638-d038107b814f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:15.385745 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-062787ac-d0bc-4f8d-a638-d038107b814f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:15.386882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-062787ac-d0bc-4f8d-a638-d038107b814f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1743 microversion: 2.20 time: 0.153499 Jul 25 12:20:15.387419 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 372/748] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:15 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:16.410624 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-bfa0916a-ff0c-4f97-8d60-b510d5a83e5f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:16.411227 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-bfa0916a-ff0c-4f97-8d60-b510d5a83e5f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:16.413633 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:16.419552 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bfa0916a-ff0c-4f97-8d60-b510d5a83e5f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:16.420009 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bfa0916a-ff0c-4f97-8d60-b510d5a83e5f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:16.420754 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bfa0916a-ff0c-4f97-8d60-b510d5a83e5f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:16.421181 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-bfa0916a-ff0c-4f97-8d60-b510d5a83e5f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:16.566660 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bfa0916a-ff0c-4f97-8d60-b510d5a83e5f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:16.574584 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bfa0916a-ff0c-4f97-8d60-b510d5a83e5f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:16.576134 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-bfa0916a-ff0c-4f97-8d60-b510d5a83e5f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:16.577322 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-bfa0916a-ff0c-4f97-8d60-b510d5a83e5f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1743 microversion: 2.20 time: 0.170681 Jul 25 12:20:16.577881 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 377/749] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:16 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:17.286283 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fc63d063-7e11-4af9-bbcd-1c31881b223b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:17.286792 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fc63d063-7e11-4af9-bbcd-1c31881b223b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:17.292934 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc63d063-7e11-4af9-bbcd-1c31881b223b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:17.293380 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc63d063-7e11-4af9-bbcd-1c31881b223b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:17.294135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc63d063-7e11-4af9-bbcd-1c31881b223b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:17.294589 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fc63d063-7e11-4af9-bbcd-1c31881b223b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:17.317851 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fc63d063-7e11-4af9-bbcd-1c31881b223b tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/ips" status: 200 len: 145 microversion: 2.1 time: 0.212023 Jul 25 12:20:17.318407 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 373/750] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Jul 25 12:20:17 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/ips => generated 145 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:17.601010 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e836285e-99d3-41e1-b0a1-9173cd96bc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:17.601623 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e836285e-99d3-41e1-b0a1-9173cd96bc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:17.608175 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e836285e-99d3-41e1-b0a1-9173cd96bc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:17.608621 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e836285e-99d3-41e1-b0a1-9173cd96bc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:17.609389 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e836285e-99d3-41e1-b0a1-9173cd96bc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:17.609824 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e836285e-99d3-41e1-b0a1-9173cd96bc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:17.741622 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e836285e-99d3-41e1-b0a1-9173cd96bc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:17.756879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e836285e-99d3-41e1-b0a1-9173cd96bc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:17.759095 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e836285e-99d3-41e1-b0a1-9173cd96bc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:17.760283 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e836285e-99d3-41e1-b0a1-9173cd96bc0d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1743 microversion: 2.20 time: 0.163124 Jul 25 12:20:17.760864 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 378/751] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:17 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:18.655172 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-05375f45-5015-4a91-905c-22c07d5a6d88 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3148fc0-f904-4f4f-be1a-011d4a3af4b8"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:20:18.658145 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-05375f45-5015-4a91-905c-22c07d5a6d88 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:18.664893 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05375f45-5015-4a91-905c-22c07d5a6d88 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:18.665343 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05375f45-5015-4a91-905c-22c07d5a6d88 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:18.666730 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05375f45-5015-4a91-905c-22c07d5a6d88 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:18.667692 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05375f45-5015-4a91-905c-22c07d5a6d88 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:18.785521 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1f6d3cd6-9234-4b9b-913c-e74df08a1e6c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:18.786208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1f6d3cd6-9234-4b9b-913c-e74df08a1e6c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:18.795079 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f6d3cd6-9234-4b9b-913c-e74df08a1e6c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:18.795836 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f6d3cd6-9234-4b9b-913c-e74df08a1e6c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:18.796918 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f6d3cd6-9234-4b9b-913c-e74df08a1e6c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:18.797576 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f6d3cd6-9234-4b9b-913c-e74df08a1e6c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:18.970391 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1f6d3cd6-9234-4b9b-913c-e74df08a1e6c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:18.971747 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-05375f45-5015-4a91-905c-22c07d5a6d88 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "POST /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319385 Jul 25 12:20:18.979828 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 374/752] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:20:18 2022] POST /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:18.996695 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1f6d3cd6-9234-4b9b-913c-e74df08a1e6c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:19.004992 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1f6d3cd6-9234-4b9b-913c-e74df08a1e6c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:19.006527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1f6d3cd6-9234-4b9b-913c-e74df08a1e6c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1738 microversion: 2.20 time: 0.227498 Jul 25 12:20:19.016981 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 379/753] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:18 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:20:19.248531 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-f4e73afc-d43b-4228-84af-fc4bb4fc855f req-ef1cabc3-ea7f-45fe-ad1b-455a8014b1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "716acb40-a825-4b9b-a5f2-63d87980cf7a", "name": "network-vif-plugged", "status": "completed", "tag": "d8ccc18c-ce12-4e5d-a124-191bdcd1d563"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:20:19.260707 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-f4e73afc-d43b-4228-84af-fc4bb4fc855f req-ef1cabc3-ea7f-45fe-ad1b-455a8014b1d1 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:19.261455 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-f4e73afc-d43b-4228-84af-fc4bb4fc855f req-ef1cabc3-ea7f-45fe-ad1b-455a8014b1d1 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:19.274471 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-f4e73afc-d43b-4228-84af-fc4bb4fc855f req-ef1cabc3-ea7f-45fe-ad1b-455a8014b1d1 service nova] Creating event network-vif-plugged:d8ccc18c-ce12-4e5d-a124-191bdcd1d563 for instance 716acb40-a825-4b9b-a5f2-63d87980cf7a on hv-cinder-79760 Jul 25 12:20:19.280622 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-f4e73afc-d43b-4228-84af-fc4bb4fc855f req-ef1cabc3-ea7f-45fe-ad1b-455a8014b1d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037048 Jul 25 12:20:19.281463 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 375/754] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:20.043067 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-83173cf6-9ff8-4210-bd03-193a2f239882 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:20.043715 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-83173cf6-9ff8-4210-bd03-193a2f239882 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:20.050614 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-83173cf6-9ff8-4210-bd03-193a2f239882 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:20.051329 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-83173cf6-9ff8-4210-bd03-193a2f239882 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:20.052132 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-83173cf6-9ff8-4210-bd03-193a2f239882 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:20.052928 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-83173cf6-9ff8-4210-bd03-193a2f239882 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:20.193007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-83173cf6-9ff8-4210-bd03-193a2f239882 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:20.201227 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-83173cf6-9ff8-4210-bd03-193a2f239882 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:20.204411 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-83173cf6-9ff8-4210-bd03-193a2f239882 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:20.205572 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-83173cf6-9ff8-4210-bd03-193a2f239882 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1738 microversion: 2.20 time: 0.167224 Jul 25 12:20:20.206126 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 380/755] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:20 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:21.233276 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-48d7d0aa-7eb2-4183-9576-5c4cd8279837 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:21.234008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-48d7d0aa-7eb2-4183-9576-5c4cd8279837 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:21.247241 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48d7d0aa-7eb2-4183-9576-5c4cd8279837 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:21.247716 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48d7d0aa-7eb2-4183-9576-5c4cd8279837 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:21.248528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48d7d0aa-7eb2-4183-9576-5c4cd8279837 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:21.249022 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-48d7d0aa-7eb2-4183-9576-5c4cd8279837 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:21.414892 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-48d7d0aa-7eb2-4183-9576-5c4cd8279837 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:21.424650 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-48d7d0aa-7eb2-4183-9576-5c4cd8279837 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:21.426248 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-48d7d0aa-7eb2-4183-9576-5c4cd8279837 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:21.427334 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-48d7d0aa-7eb2-4183-9576-5c4cd8279837 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1738 microversion: 2.20 time: 0.199722 Jul 25 12:20:21.428115 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 376/756] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:21 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:22.453115 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a2ead505-747a-4f17-b5c5-091cc9c43dbd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:22.453721 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a2ead505-747a-4f17-b5c5-091cc9c43dbd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:22.479624 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2ead505-747a-4f17-b5c5-091cc9c43dbd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:22.481063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2ead505-747a-4f17-b5c5-091cc9c43dbd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:22.482026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2ead505-747a-4f17-b5c5-091cc9c43dbd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:22.482455 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a2ead505-747a-4f17-b5c5-091cc9c43dbd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:22.640963 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a2ead505-747a-4f17-b5c5-091cc9c43dbd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:22.650787 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a2ead505-747a-4f17-b5c5-091cc9c43dbd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:22.652795 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a2ead505-747a-4f17-b5c5-091cc9c43dbd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:22.654135 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a2ead505-747a-4f17-b5c5-091cc9c43dbd tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1738 microversion: 2.20 time: 0.206730 Jul 25 12:20:22.655252 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 381/757] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:22 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:23.679166 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ca9501f5-967f-434a-9216-3ee863e503e9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:23.679794 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ca9501f5-967f-434a-9216-3ee863e503e9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:23.689647 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ca9501f5-967f-434a-9216-3ee863e503e9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:23.689647 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ca9501f5-967f-434a-9216-3ee863e503e9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:23.689822 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ca9501f5-967f-434a-9216-3ee863e503e9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:23.690248 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ca9501f5-967f-434a-9216-3ee863e503e9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:23.854603 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ca9501f5-967f-434a-9216-3ee863e503e9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:23.863111 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ca9501f5-967f-434a-9216-3ee863e503e9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:23.866464 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-ca9501f5-967f-434a-9216-3ee863e503e9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:23.868001 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ca9501f5-967f-434a-9216-3ee863e503e9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1738 microversion: 2.20 time: 0.193710 Jul 25 12:20:23.869195 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 377/758] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:23 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:24.892494 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-60adf427-45dd-4411-979a-9007e112c330 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:24.893857 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-60adf427-45dd-4411-979a-9007e112c330 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:24.900628 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60adf427-45dd-4411-979a-9007e112c330 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:24.901074 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60adf427-45dd-4411-979a-9007e112c330 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:24.902282 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60adf427-45dd-4411-979a-9007e112c330 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:24.902874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-60adf427-45dd-4411-979a-9007e112c330 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:25.098637 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-60adf427-45dd-4411-979a-9007e112c330 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:25.109059 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-60adf427-45dd-4411-979a-9007e112c330 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:25.121591 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-60adf427-45dd-4411-979a-9007e112c330 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:25.122845 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-60adf427-45dd-4411-979a-9007e112c330 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1738 microversion: 2.20 time: 0.234128 Jul 25 12:20:25.140802 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 382/759] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:24 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:26.152552 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-60cfe7ae-4d80-4538-8225-38b4a197b4b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:26.152552 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-60cfe7ae-4d80-4538-8225-38b4a197b4b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:26.155841 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-60cfe7ae-4d80-4538-8225-38b4a197b4b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:26.156306 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-60cfe7ae-4d80-4538-8225-38b4a197b4b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:26.157076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-60cfe7ae-4d80-4538-8225-38b4a197b4b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:26.157511 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-60cfe7ae-4d80-4538-8225-38b4a197b4b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:26.326126 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-60cfe7ae-4d80-4538-8225-38b4a197b4b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:26.339806 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-60cfe7ae-4d80-4538-8225-38b4a197b4b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:26.341652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-60cfe7ae-4d80-4538-8225-38b4a197b4b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:26.346704 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-60cfe7ae-4d80-4538-8225-38b4a197b4b8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1738 microversion: 2.20 time: 0.203316 Jul 25 12:20:26.347635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 378/760] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:26 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:26.608316 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-269fba25-eb62-4f41-a384-854dc6839a17 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:26.610512 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-269fba25-eb62-4f41-a384-854dc6839a17 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:26.617618 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-269fba25-eb62-4f41-a384-854dc6839a17 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:26.618845 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-269fba25-eb62-4f41-a384-854dc6839a17 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:26.619796 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-269fba25-eb62-4f41-a384-854dc6839a17 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:26.620222 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-269fba25-eb62-4f41-a384-854dc6839a17 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:26.658585 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-269fba25-eb62-4f41-a384-854dc6839a17 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057504 Jul 25 12:20:26.659703 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 383/761] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:20:26 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:26.670433 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b9d0abbf-cb4e-4303-896f-1b22e80896de tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:26.670928 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b9d0abbf-cb4e-4303-896f-1b22e80896de tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:26.677420 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9d0abbf-cb4e-4303-896f-1b22e80896de tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:26.677870 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9d0abbf-cb4e-4303-896f-1b22e80896de tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:26.678641 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9d0abbf-cb4e-4303-896f-1b22e80896de tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:26.679073 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b9d0abbf-cb4e-4303-896f-1b22e80896de tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:26.710498 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b9d0abbf-cb4e-4303-896f-1b22e80896de tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments/d3148fc0-f904-4f4f-be1a-011d4a3af4b8" status: 200 len: 194 microversion: 2.1 time: 0.043964 Jul 25 12:20:26.711269 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 379/762] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Jul 25 12:20:26 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments/d3148fc0-f904-4f4f-be1a-011d4a3af4b8 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:20:27.374161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6576a912-19ef-4c2d-8abc-5e681393a9d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:27.375059 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6576a912-19ef-4c2d-8abc-5e681393a9d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:27.381339 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6576a912-19ef-4c2d-8abc-5e681393a9d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:27.381967 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6576a912-19ef-4c2d-8abc-5e681393a9d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:27.382886 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6576a912-19ef-4c2d-8abc-5e681393a9d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:27.383306 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6576a912-19ef-4c2d-8abc-5e681393a9d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:27.535343 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6576a912-19ef-4c2d-8abc-5e681393a9d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:27.544004 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6576a912-19ef-4c2d-8abc-5e681393a9d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:27.545804 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6576a912-19ef-4c2d-8abc-5e681393a9d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:27.547106 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6576a912-19ef-4c2d-8abc-5e681393a9d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1738 microversion: 2.20 time: 0.177023 Jul 25 12:20:27.558427 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 384/763] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:27 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:28.570321 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-14d96bb4-c834-42ed-82d5-7a3245d4d272 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:28.571521 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-14d96bb4-c834-42ed-82d5-7a3245d4d272 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:28.578061 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14d96bb4-c834-42ed-82d5-7a3245d4d272 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:28.578542 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14d96bb4-c834-42ed-82d5-7a3245d4d272 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:28.579301 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14d96bb4-c834-42ed-82d5-7a3245d4d272 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:28.579779 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14d96bb4-c834-42ed-82d5-7a3245d4d272 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:28.706430 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-14d96bb4-c834-42ed-82d5-7a3245d4d272 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:28.714257 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-14d96bb4-c834-42ed-82d5-7a3245d4d272 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:28.715787 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-14d96bb4-c834-42ed-82d5-7a3245d4d272 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:28.716941 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-14d96bb4-c834-42ed-82d5-7a3245d4d272 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1738 microversion: 2.20 time: 0.150608 Jul 25 12:20:28.717494 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 380/764] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:28 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:29.149961 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-40da50ee-aa36-428b-8efc-cd31399cea8a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e97a41c-b117-479a-911d-76ab32260a0e"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:20:29.153731 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-40da50ee-aa36-428b-8efc-cd31399cea8a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:29.162579 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-40da50ee-aa36-428b-8efc-cd31399cea8a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:29.163023 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-40da50ee-aa36-428b-8efc-cd31399cea8a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:29.163844 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-40da50ee-aa36-428b-8efc-cd31399cea8a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:29.164283 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-40da50ee-aa36-428b-8efc-cd31399cea8a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:29.299999 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:29.440561 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-40da50ee-aa36-428b-8efc-cd31399cea8a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "POST /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295001 Jul 25 12:20:29.441251 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 385/765] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:20:29 2022] POST /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:29.740861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5aea7225-5716-4a9a-877f-aff62ae7559f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:29.741408 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5aea7225-5716-4a9a-877f-aff62ae7559f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:29.748819 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aea7225-5716-4a9a-877f-aff62ae7559f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:29.749262 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aea7225-5716-4a9a-877f-aff62ae7559f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:29.750009 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aea7225-5716-4a9a-877f-aff62ae7559f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:29.750433 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5aea7225-5716-4a9a-877f-aff62ae7559f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:29.766321 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:29.889879 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5aea7225-5716-4a9a-877f-aff62ae7559f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:29.897883 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5aea7225-5716-4a9a-877f-aff62ae7559f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:29.899462 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5aea7225-5716-4a9a-877f-aff62ae7559f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:29.901151 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5aea7225-5716-4a9a-877f-aff62ae7559f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1720 microversion: 2.20 time: 0.164274 Jul 25 12:20:29.901959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 381/766] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:29 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:30.925606 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1f8fbf6f-5db3-4313-80df-769ebf8a82a7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:30.926310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1f8fbf6f-5db3-4313-80df-769ebf8a82a7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:30.932519 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f8fbf6f-5db3-4313-80df-769ebf8a82a7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:30.933035 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f8fbf6f-5db3-4313-80df-769ebf8a82a7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:30.933809 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f8fbf6f-5db3-4313-80df-769ebf8a82a7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:30.934249 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1f8fbf6f-5db3-4313-80df-769ebf8a82a7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:31.070574 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1f8fbf6f-5db3-4313-80df-769ebf8a82a7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:31.078950 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1f8fbf6f-5db3-4313-80df-769ebf8a82a7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:31.080494 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1f8fbf6f-5db3-4313-80df-769ebf8a82a7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:31.081650 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1f8fbf6f-5db3-4313-80df-769ebf8a82a7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1720 microversion: 2.20 time: 0.160815 Jul 25 12:20:31.082242 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 386/767] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:30 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:32.106835 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d2c61066-ac8e-4461-a881-08436b28b8f0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:32.107479 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d2c61066-ac8e-4461-a881-08436b28b8f0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:32.114001 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d2c61066-ac8e-4461-a881-08436b28b8f0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:32.114449 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d2c61066-ac8e-4461-a881-08436b28b8f0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:32.115202 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d2c61066-ac8e-4461-a881-08436b28b8f0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:32.115659 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d2c61066-ac8e-4461-a881-08436b28b8f0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:32.241420 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d2c61066-ac8e-4461-a881-08436b28b8f0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:32.249238 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d2c61066-ac8e-4461-a881-08436b28b8f0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:32.250746 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d2c61066-ac8e-4461-a881-08436b28b8f0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:32.251923 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d2c61066-ac8e-4461-a881-08436b28b8f0 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1723 microversion: 2.20 time: 0.149724 Jul 25 12:20:32.252480 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 382/768] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:32 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:32.274751 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b41f19d8-bcce-44ab-89e9-f99d658ba890 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0120530c-b70a-4beb-a6a2-94ef5bc64b1a"}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:20:32.277492 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b41f19d8-bcce-44ab-89e9-f99d658ba890 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:32.283820 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b41f19d8-bcce-44ab-89e9-f99d658ba890 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:32.284257 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b41f19d8-bcce-44ab-89e9-f99d658ba890 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:32.284998 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b41f19d8-bcce-44ab-89e9-f99d658ba890 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:32.285420 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b41f19d8-bcce-44ab-89e9-f99d658ba890 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:32.551654 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b41f19d8-bcce-44ab-89e9-f99d658ba890 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "POST /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.281281 Jul 25 12:20:32.552259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 387/769] 10.222.0.42 () {62 vars in 1364 bytes} [Mon Jul 25 12:20:32 2022] POST /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/os-volume_attachments => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:20:32.673805 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ae98f1b8-1e9b-4e52-b149-52d531450d05 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:32.674668 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ae98f1b8-1e9b-4e52-b149-52d531450d05 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:32.680367 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ae98f1b8-1e9b-4e52-b149-52d531450d05 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:32.680845 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ae98f1b8-1e9b-4e52-b149-52d531450d05 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:32.681608 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ae98f1b8-1e9b-4e52-b149-52d531450d05 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:32.682039 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ae98f1b8-1e9b-4e52-b149-52d531450d05 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:33.780126 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ae98f1b8-1e9b-4e52-b149-52d531450d05 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "DELETE /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/os-volume_attachments/0120530c-b70a-4beb-a6a2-94ef5bc64b1a" status: 202 len: 0 microversion: 2.20 time: 1.110051 Jul 25 12:20:33.780763 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 383/770] 10.222.0.42 () {60 vars in 1457 bytes} [Mon Jul 25 12:20:32 2022] DELETE /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/os-volume_attachments/0120530c-b70a-4beb-a6a2-94ef5bc64b1a => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:20:33.893226 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-fd4098d8-0aeb-4e57-8bc1-b6176de7d7ec req-0b552f1d-dafc-4599-bd47-dad9f60df035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "716acb40-a825-4b9b-a5f2-63d87980cf7a", "name": "network-vif-unplugged", "status": "completed", "tag": "d8ccc18c-ce12-4e5d-a124-191bdcd1d563"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:20:33.904150 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-fd4098d8-0aeb-4e57-8bc1-b6176de7d7ec req-0b552f1d-dafc-4599-bd47-dad9f60df035 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:33.904625 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-fd4098d8-0aeb-4e57-8bc1-b6176de7d7ec req-0b552f1d-dafc-4599-bd47-dad9f60df035 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:33.914373 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8443f7c1-c896-4cef-b6a7-f3577811478e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:20:33.914934 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8443f7c1-c896-4cef-b6a7-f3577811478e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:33.915075 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-fd4098d8-0aeb-4e57-8bc1-b6176de7d7ec req-0b552f1d-dafc-4599-bd47-dad9f60df035 service nova] Creating event network-vif-unplugged:d8ccc18c-ce12-4e5d-a124-191bdcd1d563 for instance 716acb40-a825-4b9b-a5f2-63d87980cf7a on hv-cinder-79760 Jul 25 12:20:33.920004 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-fd4098d8-0aeb-4e57-8bc1-b6176de7d7ec req-0b552f1d-dafc-4599-bd47-dad9f60df035 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098959 Jul 25 12:20:33.920596 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 388/771] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:33.921409 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8443f7c1-c896-4cef-b6a7-f3577811478e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:33.921861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8443f7c1-c896-4cef-b6a7-f3577811478e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:33.922653 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8443f7c1-c896-4cef-b6a7-f3577811478e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:33.923088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8443f7c1-c896-4cef-b6a7-f3577811478e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:33.999348 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8443f7c1-c896-4cef-b6a7-f3577811478e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "POST /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/action" status: 202 len: 0 microversion: 2.20 time: 0.089174 Jul 25 12:20:33.999907 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 384/772] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Jul 25 12:20:33 2022] POST /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:20:34.009469 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4f6cce34-2557-4ef2-8b6c-105b5596b3ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:34.010251 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4f6cce34-2557-4ef2-8b6c-105b5596b3ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:34.016564 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f6cce34-2557-4ef2-8b6c-105b5596b3ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:34.017008 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f6cce34-2557-4ef2-8b6c-105b5596b3ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:34.017773 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f6cce34-2557-4ef2-8b6c-105b5596b3ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:34.018209 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4f6cce34-2557-4ef2-8b6c-105b5596b3ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:34.173740 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4f6cce34-2557-4ef2-8b6c-105b5596b3ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:34.182604 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4f6cce34-2557-4ef2-8b6c-105b5596b3ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:34.184335 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4f6cce34-2557-4ef2-8b6c-105b5596b3ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:34.185547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4f6cce34-2557-4ef2-8b6c-105b5596b3ed tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1731 microversion: 2.20 time: 0.180991 Jul 25 12:20:34.186230 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 389/773] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:34 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:20:35.209915 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f1ffe241-81ae-4856-84c4-8584a39c445f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:35.210516 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f1ffe241-81ae-4856-84c4-8584a39c445f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:35.216481 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1ffe241-81ae-4856-84c4-8584a39c445f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:35.216924 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1ffe241-81ae-4856-84c4-8584a39c445f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:35.217674 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1ffe241-81ae-4856-84c4-8584a39c445f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:35.218098 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f1ffe241-81ae-4856-84c4-8584a39c445f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:35.344608 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f1ffe241-81ae-4856-84c4-8584a39c445f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:35.352893 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f1ffe241-81ae-4856-84c4-8584a39c445f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:35.354367 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f1ffe241-81ae-4856-84c4-8584a39c445f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:35.355501 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f1ffe241-81ae-4856-84c4-8584a39c445f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.150088 Jul 25 12:20:35.356076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 385/774] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:35 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:36.379816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-504b59fd-bd48-4abf-8fbf-1549f2ec645f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:36.380962 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-504b59fd-bd48-4abf-8fbf-1549f2ec645f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:36.390067 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-504b59fd-bd48-4abf-8fbf-1549f2ec645f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:36.390888 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-504b59fd-bd48-4abf-8fbf-1549f2ec645f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:36.392366 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-504b59fd-bd48-4abf-8fbf-1549f2ec645f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:36.393135 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-504b59fd-bd48-4abf-8fbf-1549f2ec645f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:36.542016 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-504b59fd-bd48-4abf-8fbf-1549f2ec645f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:36.554158 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-504b59fd-bd48-4abf-8fbf-1549f2ec645f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:36.556471 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-504b59fd-bd48-4abf-8fbf-1549f2ec645f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:36.557721 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-504b59fd-bd48-4abf-8fbf-1549f2ec645f tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.182298 Jul 25 12:20:36.558489 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 390/775] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:36 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:37.582167 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5d27b902-0f95-4c39-bd31-45b9cfd81889 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:37.582766 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5d27b902-0f95-4c39-bd31-45b9cfd81889 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:37.592513 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d27b902-0f95-4c39-bd31-45b9cfd81889 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:37.592967 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d27b902-0f95-4c39-bd31-45b9cfd81889 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:37.596187 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d27b902-0f95-4c39-bd31-45b9cfd81889 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:37.596651 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d27b902-0f95-4c39-bd31-45b9cfd81889 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:37.736757 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5d27b902-0f95-4c39-bd31-45b9cfd81889 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:37.744704 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5d27b902-0f95-4c39-bd31-45b9cfd81889 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:37.746223 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5d27b902-0f95-4c39-bd31-45b9cfd81889 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:37.747402 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5d27b902-0f95-4c39-bd31-45b9cfd81889 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.169135 Jul 25 12:20:37.747990 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 386/776] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:37 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:38.773494 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c0150a81-d99e-43dc-9ccd-886486dce7a1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:38.775650 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c0150a81-d99e-43dc-9ccd-886486dce7a1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:38.785774 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c0150a81-d99e-43dc-9ccd-886486dce7a1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:38.786301 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c0150a81-d99e-43dc-9ccd-886486dce7a1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:38.787156 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c0150a81-d99e-43dc-9ccd-886486dce7a1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:38.787705 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c0150a81-d99e-43dc-9ccd-886486dce7a1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:38.930004 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c0150a81-d99e-43dc-9ccd-886486dce7a1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:38.941538 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c0150a81-d99e-43dc-9ccd-886486dce7a1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:38.943030 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c0150a81-d99e-43dc-9ccd-886486dce7a1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:38.944215 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c0150a81-d99e-43dc-9ccd-886486dce7a1 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.176553 Jul 25 12:20:38.944770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 391/777] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:38 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:39.968867 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3a1a6223-19b5-441e-a4c5-419a83b336d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:39.969576 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3a1a6223-19b5-441e-a4c5-419a83b336d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:39.976720 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a1a6223-19b5-441e-a4c5-419a83b336d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:39.977357 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a1a6223-19b5-441e-a4c5-419a83b336d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:39.978162 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a1a6223-19b5-441e-a4c5-419a83b336d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:39.978590 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3a1a6223-19b5-441e-a4c5-419a83b336d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:40.116633 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3a1a6223-19b5-441e-a4c5-419a83b336d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:40.124921 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3a1a6223-19b5-441e-a4c5-419a83b336d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:40.126491 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3a1a6223-19b5-441e-a4c5-419a83b336d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:40.127928 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3a1a6223-19b5-441e-a4c5-419a83b336d4 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.162900 Jul 25 12:20:40.139572 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 387/778] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:39 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:41.156633 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9ae67366-93e3-4083-b921-788e59536c85 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:41.158098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9ae67366-93e3-4083-b921-788e59536c85 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:41.165927 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ae67366-93e3-4083-b921-788e59536c85 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:41.166471 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ae67366-93e3-4083-b921-788e59536c85 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:41.167323 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ae67366-93e3-4083-b921-788e59536c85 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:41.168103 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9ae67366-93e3-4083-b921-788e59536c85 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:41.328068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9ae67366-93e3-4083-b921-788e59536c85 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:41.336291 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9ae67366-93e3-4083-b921-788e59536c85 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:41.338387 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9ae67366-93e3-4083-b921-788e59536c85 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:41.339577 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9ae67366-93e3-4083-b921-788e59536c85 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.186913 Jul 25 12:20:41.340153 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 392/779] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:41 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:42.363241 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-90a4b1cc-ef12-4fb9-ac86-f2e6c1d4df86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:42.363872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-90a4b1cc-ef12-4fb9-ac86-f2e6c1d4df86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:42.367224 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=44 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:42.371226 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90a4b1cc-ef12-4fb9-ac86-f2e6c1d4df86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:42.371714 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90a4b1cc-ef12-4fb9-ac86-f2e6c1d4df86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:42.372494 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90a4b1cc-ef12-4fb9-ac86-f2e6c1d4df86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:42.373044 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90a4b1cc-ef12-4fb9-ac86-f2e6c1d4df86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:42.513271 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-90a4b1cc-ef12-4fb9-ac86-f2e6c1d4df86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:42.521599 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-90a4b1cc-ef12-4fb9-ac86-f2e6c1d4df86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:42.523111 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-90a4b1cc-ef12-4fb9-ac86-f2e6c1d4df86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:42.524357 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-90a4b1cc-ef12-4fb9-ac86-f2e6c1d4df86 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.165566 Jul 25 12:20:42.538203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 388/780] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:42 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:20:43.549713 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-43b23395-7301-4a3f-9603-18f4c4fa948d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:43.550563 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-43b23395-7301-4a3f-9603-18f4c4fa948d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:43.557903 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43b23395-7301-4a3f-9603-18f4c4fa948d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:43.559582 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43b23395-7301-4a3f-9603-18f4c4fa948d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:43.560360 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43b23395-7301-4a3f-9603-18f4c4fa948d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:43.562271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43b23395-7301-4a3f-9603-18f4c4fa948d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:43.710948 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-43b23395-7301-4a3f-9603-18f4c4fa948d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:43.719897 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-43b23395-7301-4a3f-9603-18f4c4fa948d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:43.721413 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-43b23395-7301-4a3f-9603-18f4c4fa948d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:43.722796 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-43b23395-7301-4a3f-9603-18f4c4fa948d tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.177118 Jul 25 12:20:43.723352 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 393/781] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:43 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:44.746809 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-713ef273-2850-4de1-9088-436103f5ce47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:44.747432 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-713ef273-2850-4de1-9088-436103f5ce47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:44.754179 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-713ef273-2850-4de1-9088-436103f5ce47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:44.754625 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-713ef273-2850-4de1-9088-436103f5ce47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:44.755386 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-713ef273-2850-4de1-9088-436103f5ce47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:44.755837 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-713ef273-2850-4de1-9088-436103f5ce47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:44.945105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-713ef273-2850-4de1-9088-436103f5ce47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:44.953770 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-713ef273-2850-4de1-9088-436103f5ce47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:44.955623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-713ef273-2850-4de1-9088-436103f5ce47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:44.956842 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-713ef273-2850-4de1-9088-436103f5ce47 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.214595 Jul 25 12:20:44.957406 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 389/782] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:44 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:45.980964 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-26b07d35-44dc-4666-830c-07d6536cb4fe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:45.981568 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-26b07d35-44dc-4666-830c-07d6536cb4fe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:45.987900 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26b07d35-44dc-4666-830c-07d6536cb4fe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:45.988353 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26b07d35-44dc-4666-830c-07d6536cb4fe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:45.989096 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26b07d35-44dc-4666-830c-07d6536cb4fe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:45.989521 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-26b07d35-44dc-4666-830c-07d6536cb4fe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:46.118523 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-26b07d35-44dc-4666-830c-07d6536cb4fe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:46.126850 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-26b07d35-44dc-4666-830c-07d6536cb4fe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:46.128395 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-26b07d35-44dc-4666-830c-07d6536cb4fe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:46.129775 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-26b07d35-44dc-4666-830c-07d6536cb4fe tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.152692 Jul 25 12:20:46.130904 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 394/783] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:45 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:47.155522 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-a1587cd6-6868-40ac-8dcf-c5c93bc6b2a3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:47.156167 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-a1587cd6-6868-40ac-8dcf-c5c93bc6b2a3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:47.165075 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a1587cd6-6868-40ac-8dcf-c5c93bc6b2a3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:47.166103 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a1587cd6-6868-40ac-8dcf-c5c93bc6b2a3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:47.166878 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a1587cd6-6868-40ac-8dcf-c5c93bc6b2a3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:47.170314 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-a1587cd6-6868-40ac-8dcf-c5c93bc6b2a3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:47.393059 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a1587cd6-6868-40ac-8dcf-c5c93bc6b2a3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:47.402347 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a1587cd6-6868-40ac-8dcf-c5c93bc6b2a3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:47.417651 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-a1587cd6-6868-40ac-8dcf-c5c93bc6b2a3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:47.419225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-a1587cd6-6868-40ac-8dcf-c5c93bc6b2a3 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.267573 Jul 25 12:20:47.420327 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 390/784] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:47 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:47.684747 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-95e15cb4-3072-421c-8a1a-7bd5a3f23c1a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:47.686987 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-95e15cb4-3072-421c-8a1a-7bd5a3f23c1a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:47.689437 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=36 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:47.694680 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95e15cb4-3072-421c-8a1a-7bd5a3f23c1a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:47.695121 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95e15cb4-3072-421c-8a1a-7bd5a3f23c1a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:47.695902 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95e15cb4-3072-421c-8a1a-7bd5a3f23c1a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:47.696333 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95e15cb4-3072-421c-8a1a-7bd5a3f23c1a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:47.726103 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-95e15cb4-3072-421c-8a1a-7bd5a3f23c1a tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045800 Jul 25 12:20:47.726654 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 395/785] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:20:47 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:47.873751 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5d2bee48-68b5-4c79-bc34-b5d17c06e15f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:47.874167 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5d2bee48-68b5-4c79-bc34-b5d17c06e15f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:47.880108 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d2bee48-68b5-4c79-bc34-b5d17c06e15f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:47.880550 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d2bee48-68b5-4c79-bc34-b5d17c06e15f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:47.881298 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d2bee48-68b5-4c79-bc34-b5d17c06e15f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:47.881724 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d2bee48-68b5-4c79-bc34-b5d17c06e15f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:47.909705 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5d2bee48-68b5-4c79-bc34-b5d17c06e15f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments/d3148fc0-f904-4f4f-be1a-011d4a3af4b8" status: 200 len: 194 microversion: 2.1 time: 0.040015 Jul 25 12:20:47.910256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 391/786] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Jul 25 12:20:47 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments/d3148fc0-f904-4f4f-be1a-011d4a3af4b8 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:47.921213 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6ee1ca62-43b7-4268-8141-99f4ecb122f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:47.921737 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6ee1ca62-43b7-4268-8141-99f4ecb122f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:47.928167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ee1ca62-43b7-4268-8141-99f4ecb122f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:47.928645 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ee1ca62-43b7-4268-8141-99f4ecb122f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:47.929606 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ee1ca62-43b7-4268-8141-99f4ecb122f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:47.930073 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6ee1ca62-43b7-4268-8141-99f4ecb122f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:48.012419 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-6ee1ca62-43b7-4268-8141-99f4ecb122f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lazy-loading 'services' on Instance uuid d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:20:48.083457 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6ee1ca62-43b7-4268-8141-99f4ecb122f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments/d3148fc0-f904-4f4f-be1a-011d4a3af4b8" status: 202 len: 0 microversion: 2.1 time: 0.166143 Jul 25 12:20:48.084076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 396/787] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Jul 25 12:20:47 2022] DELETE /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments/d3148fc0-f904-4f4f-be1a-011d4a3af4b8 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:20:48.443683 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-15b36085-1aa5-49b4-b0ac-558ce79c4cd9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:48.444294 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-15b36085-1aa5-49b4-b0ac-558ce79c4cd9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:48.451298 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15b36085-1aa5-49b4-b0ac-558ce79c4cd9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:48.451789 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15b36085-1aa5-49b4-b0ac-558ce79c4cd9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:48.452581 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15b36085-1aa5-49b4-b0ac-558ce79c4cd9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:48.453018 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-15b36085-1aa5-49b4-b0ac-558ce79c4cd9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:48.592626 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-15b36085-1aa5-49b4-b0ac-558ce79c4cd9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:48.601437 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-15b36085-1aa5-49b4-b0ac-558ce79c4cd9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:48.602932 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-15b36085-1aa5-49b4-b0ac-558ce79c4cd9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:48.604137 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-15b36085-1aa5-49b4-b0ac-558ce79c4cd9 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.164259 Jul 25 12:20:48.604874 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 392/788] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:48 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:49.629557 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-53a5c9e7-d426-43e0-87ed-3d104c339279 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:49.630446 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-53a5c9e7-d426-43e0-87ed-3d104c339279 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:49.637406 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-53a5c9e7-d426-43e0-87ed-3d104c339279 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:49.637851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-53a5c9e7-d426-43e0-87ed-3d104c339279 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:49.638596 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-53a5c9e7-d426-43e0-87ed-3d104c339279 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:49.639022 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-53a5c9e7-d426-43e0-87ed-3d104c339279 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:49.768719 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-53a5c9e7-d426-43e0-87ed-3d104c339279 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:49.777634 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-53a5c9e7-d426-43e0-87ed-3d104c339279 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:49.779123 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-53a5c9e7-d426-43e0-87ed-3d104c339279 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:49.780293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-53a5c9e7-d426-43e0-87ed-3d104c339279 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.155806 Jul 25 12:20:49.781133 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 397/789] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:49 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:50.260412 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-14732aeb-7225-4659-ae57-377bbd8a834f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:50.260909 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-14732aeb-7225-4659-ae57-377bbd8a834f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:50.268378 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14732aeb-7225-4659-ae57-377bbd8a834f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:50.268829 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14732aeb-7225-4659-ae57-377bbd8a834f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:50.269626 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14732aeb-7225-4659-ae57-377bbd8a834f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:50.270061 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-14732aeb-7225-4659-ae57-377bbd8a834f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:50.301511 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-14732aeb-7225-4659-ae57-377bbd8a834f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments/2e97a41c-b117-479a-911d-76ab32260a0e" status: 200 len: 194 microversion: 2.1 time: 0.045785 Jul 25 12:20:50.302496 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 393/790] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Jul 25 12:20:50 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments/2e97a41c-b117-479a-911d-76ab32260a0e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:50.313303 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-195d5d0d-c162-4d2b-909b-94a07ca908f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:50.313794 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-195d5d0d-c162-4d2b-909b-94a07ca908f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:50.319791 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-195d5d0d-c162-4d2b-909b-94a07ca908f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:50.320234 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-195d5d0d-c162-4d2b-909b-94a07ca908f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:50.321194 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-195d5d0d-c162-4d2b-909b-94a07ca908f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:50.321622 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-195d5d0d-c162-4d2b-909b-94a07ca908f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:50.409926 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-195d5d0d-c162-4d2b-909b-94a07ca908f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lazy-loading 'services' on Instance uuid d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:20:50.413445 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=5,nova_cell1:INSERT=5 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:50.485832 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-195d5d0d-c162-4d2b-909b-94a07ca908f3 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments/2e97a41c-b117-479a-911d-76ab32260a0e" status: 202 len: 0 microversion: 2.1 time: 0.176065 Jul 25 12:20:50.486628 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 398/791] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Jul 25 12:20:50 2022] DELETE /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments/2e97a41c-b117-479a-911d-76ab32260a0e => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:20:50.804196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5369a384-3578-4969-acdd-769f99528703 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:50.804800 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5369a384-3578-4969-acdd-769f99528703 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:50.810580 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5369a384-3578-4969-acdd-769f99528703 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:50.811018 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5369a384-3578-4969-acdd-769f99528703 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:50.811802 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5369a384-3578-4969-acdd-769f99528703 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:50.812226 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5369a384-3578-4969-acdd-769f99528703 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:50.830844 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:50.998490 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5369a384-3578-4969-acdd-769f99528703 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:51.007987 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5369a384-3578-4969-acdd-769f99528703 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:51.010060 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5369a384-3578-4969-acdd-769f99528703 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:51.011314 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5369a384-3578-4969-acdd-769f99528703 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.211216 Jul 25 12:20:51.024030 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 394/792] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:50 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:51.664730 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-95efe522-73db-447b-8640-01314771a2a7 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:51.667105 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-95efe522-73db-447b-8640-01314771a2a7 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:51.673853 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95efe522-73db-447b-8640-01314771a2a7 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:51.674297 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95efe522-73db-447b-8640-01314771a2a7 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:51.675061 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95efe522-73db-447b-8640-01314771a2a7 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:51.675492 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-95efe522-73db-447b-8640-01314771a2a7 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:51.704249 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-95efe522-73db-447b-8640-01314771a2a7 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043737 Jul 25 12:20:51.704814 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 399/793] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:20:51 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:20:51.839051 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7624fa25-013d-497f-ae69-3b7b8efec793 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:51.842345 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7624fa25-013d-497f-ae69-3b7b8efec793 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:51.848898 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7624fa25-013d-497f-ae69-3b7b8efec793 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:51.849557 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7624fa25-013d-497f-ae69-3b7b8efec793 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:51.850342 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7624fa25-013d-497f-ae69-3b7b8efec793 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:51.850777 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7624fa25-013d-497f-ae69-3b7b8efec793 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:51.880461 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7624fa25-013d-497f-ae69-3b7b8efec793 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045250 Jul 25 12:20:51.886336 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 395/794] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:20:51 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:20:51.947695 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-398a20a7-f3a3-4b60-a8e6-cc488ed895ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:51.948368 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-398a20a7-f3a3-4b60-a8e6-cc488ed895ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:51.954691 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-398a20a7-f3a3-4b60-a8e6-cc488ed895ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:51.955107 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-398a20a7-f3a3-4b60-a8e6-cc488ed895ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:51.956088 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-398a20a7-f3a3-4b60-a8e6-cc488ed895ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:51.956681 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-398a20a7-f3a3-4b60-a8e6-cc488ed895ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:51.961272 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-b22b2bc9-0533-46a3-aba4-c432786ba5b1 req-c425852f-37df-4e7a-9243-4566569f2c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "716acb40-a825-4b9b-a5f2-63d87980cf7a", "name": "network-vif-plugged", "status": "completed", "tag": "d8ccc18c-ce12-4e5d-a124-191bdcd1d563"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:20:51.972730 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b22b2bc9-0533-46a3-aba4-c432786ba5b1 req-c425852f-37df-4e7a-9243-4566569f2c7c service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:51.973178 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-b22b2bc9-0533-46a3-aba4-c432786ba5b1 req-c425852f-37df-4e7a-9243-4566569f2c7c service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:51.986705 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-b22b2bc9-0533-46a3-aba4-c432786ba5b1 req-c425852f-37df-4e7a-9243-4566569f2c7c service nova] Creating event network-vif-plugged:d8ccc18c-ce12-4e5d-a124-191bdcd1d563 for instance 716acb40-a825-4b9b-a5f2-63d87980cf7a on hv-cinder-79760 Jul 25 12:20:51.989989 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-398a20a7-f3a3-4b60-a8e6-cc488ed895ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:20:51.991817 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-b22b2bc9-0533-46a3-aba4-c432786ba5b1 req-c425852f-37df-4e7a-9243-4566569f2c7c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036775 Jul 25 12:20:51.992859 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 396/795] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:20:52.037184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e0d1f0f1-3262-49cd-889a-1589b08c9dfb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:52.038055 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e0d1f0f1-3262-49cd-889a-1589b08c9dfb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:52.045647 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0d1f0f1-3262-49cd-889a-1589b08c9dfb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:52.046176 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0d1f0f1-3262-49cd-889a-1589b08c9dfb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:52.047024 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0d1f0f1-3262-49cd-889a-1589b08c9dfb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:52.047520 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e0d1f0f1-3262-49cd-889a-1589b08c9dfb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:52.101412 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-398a20a7-f3a3-4b60-a8e6-cc488ed895ef tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 204 len: 0 microversion: 2.1 time: 0.157895 Jul 25 12:20:52.101930 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 400/796] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:20:51 2022] DELETE /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:20:52.112052 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-350b58ba-3627-43e7-973b-b3fbd3b7e7e1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:52.112992 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-350b58ba-3627-43e7-973b-b3fbd3b7e7e1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:52.121784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-350b58ba-3627-43e7-973b-b3fbd3b7e7e1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:52.122486 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-350b58ba-3627-43e7-973b-b3fbd3b7e7e1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:52.124026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-350b58ba-3627-43e7-973b-b3fbd3b7e7e1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:52.124786 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-350b58ba-3627-43e7-973b-b3fbd3b7e7e1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:52.189073 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e0d1f0f1-3262-49cd-889a-1589b08c9dfb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:52.197246 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e0d1f0f1-3262-49cd-889a-1589b08c9dfb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:52.198811 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e0d1f0f1-3262-49cd-889a-1589b08c9dfb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:52.200077 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e0d1f0f1-3262-49cd-889a-1589b08c9dfb tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.167131 Jul 25 12:20:52.200701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 397/797] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:52 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:52.264617 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-350b58ba-3627-43e7-973b-b3fbd3b7e7e1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:52.272077 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-350b58ba-3627-43e7-973b-b3fbd3b7e7e1 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1671 microversion: 2.1 time: 0.165001 Jul 25 12:20:52.272640 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 401/798] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:52 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:20:53.223848 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b85e1e64-a2f0-4d80-a2cc-5fda9a0b3067 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:53.224461 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b85e1e64-a2f0-4d80-a2cc-5fda9a0b3067 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:53.231325 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b85e1e64-a2f0-4d80-a2cc-5fda9a0b3067 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:53.231840 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b85e1e64-a2f0-4d80-a2cc-5fda9a0b3067 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:53.232597 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b85e1e64-a2f0-4d80-a2cc-5fda9a0b3067 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:53.233027 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b85e1e64-a2f0-4d80-a2cc-5fda9a0b3067 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:53.293937 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e37fb7c0-4297-441c-8c7b-36746132b1f5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:53.295176 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e37fb7c0-4297-441c-8c7b-36746132b1f5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:53.301843 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e37fb7c0-4297-441c-8c7b-36746132b1f5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:53.302488 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e37fb7c0-4297-441c-8c7b-36746132b1f5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:53.303421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e37fb7c0-4297-441c-8c7b-36746132b1f5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:53.303951 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e37fb7c0-4297-441c-8c7b-36746132b1f5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:53.368881 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b85e1e64-a2f0-4d80-a2cc-5fda9a0b3067 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:53.378201 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b85e1e64-a2f0-4d80-a2cc-5fda9a0b3067 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:53.380101 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b85e1e64-a2f0-4d80-a2cc-5fda9a0b3067 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:53.381259 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b85e1e64-a2f0-4d80-a2cc-5fda9a0b3067 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.161248 Jul 25 12:20:53.381967 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 398/799] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:53 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:53.444064 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e37fb7c0-4297-441c-8c7b-36746132b1f5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:53.452151 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e37fb7c0-4297-441c-8c7b-36746132b1f5 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1671 microversion: 2.1 time: 0.162061 Jul 25 12:20:53.452722 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 402/800] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:53 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:20:53.854620 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-770cf82d-e35e-440c-99bb-979af8bbb794 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:53.855109 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-770cf82d-e35e-440c-99bb-979af8bbb794 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:53.861192 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-770cf82d-e35e-440c-99bb-979af8bbb794 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:53.861655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-770cf82d-e35e-440c-99bb-979af8bbb794 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:53.862476 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-770cf82d-e35e-440c-99bb-979af8bbb794 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:53.862919 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-770cf82d-e35e-440c-99bb-979af8bbb794 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:54.038733 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-770cf82d-e35e-440c-99bb-979af8bbb794 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d/ips" status: 200 len: 150 microversion: 2.1 time: 0.188468 Jul 25 12:20:54.039184 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 399/801] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Jul 25 12:20:53 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d/ips => generated 150 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:54.406192 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-24dae346-669c-4a86-b476-8e00e9a967ff tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:54.406800 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-24dae346-669c-4a86-b476-8e00e9a967ff tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:54.413275 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24dae346-669c-4a86-b476-8e00e9a967ff tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:54.413722 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24dae346-669c-4a86-b476-8e00e9a967ff tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:54.415566 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24dae346-669c-4a86-b476-8e00e9a967ff tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:54.415566 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-24dae346-669c-4a86-b476-8e00e9a967ff tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:54.474286 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4766e4b1-73aa-42ca-bbbf-6736cbb7865d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:54.474986 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4766e4b1-73aa-42ca-bbbf-6736cbb7865d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:54.482875 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4766e4b1-73aa-42ca-bbbf-6736cbb7865d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:54.483330 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4766e4b1-73aa-42ca-bbbf-6736cbb7865d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:54.484144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4766e4b1-73aa-42ca-bbbf-6736cbb7865d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:54.484582 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4766e4b1-73aa-42ca-bbbf-6736cbb7865d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:54.546603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-24dae346-669c-4a86-b476-8e00e9a967ff tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:54.554871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-24dae346-669c-4a86-b476-8e00e9a967ff tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:54.556494 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-24dae346-669c-4a86-b476-8e00e9a967ff tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:54.557655 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-24dae346-669c-4a86-b476-8e00e9a967ff tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.155378 Jul 25 12:20:54.558540 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 403/802] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:54 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:54.688398 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4766e4b1-73aa-42ca-bbbf-6736cbb7865d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:54.697599 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4766e4b1-73aa-42ca-bbbf-6736cbb7865d tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1671 microversion: 2.1 time: 0.227207 Jul 25 12:20:54.698708 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 400/803] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:54 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1671 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:20:55.388510 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-86789163-dd88-4cde-83c3-ac8177b4f6fd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea1896f1-0543-4afc-9f51-2ac74a649a39"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:20:55.392602 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-86789163-dd88-4cde-83c3-ac8177b4f6fd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:55.405732 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86789163-dd88-4cde-83c3-ac8177b4f6fd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:55.406187 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86789163-dd88-4cde-83c3-ac8177b4f6fd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:55.407227 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86789163-dd88-4cde-83c3-ac8177b4f6fd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:55.407685 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-86789163-dd88-4cde-83c3-ac8177b4f6fd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:55.476811 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-f67d18bc-2a18-45db-9c6b-22cf8e04e647 req-c45dd408-e4b9-494c-a965-c9a81911c290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031", "name": "network-vif-deleted", "tag": "f559cf1f-0667-4b67-ada9-e67f8af17d57"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:20:55.488334 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-f67d18bc-2a18-45db-9c6b-22cf8e04e647 req-c45dd408-e4b9-494c-a965-c9a81911c290 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:55.489109 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-f67d18bc-2a18-45db-9c6b-22cf8e04e647 req-c45dd408-e4b9-494c-a965-c9a81911c290 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:55.514034 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-f67d18bc-2a18-45db-9c6b-22cf8e04e647 req-c45dd408-e4b9-494c-a965-c9a81911c290 service nova] Creating event network-vif-deleted:f559cf1f-0667-4b67-ada9-e67f8af17d57 for instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 on hv-cinder-79760 Jul 25 12:20:55.520383 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-f67d18bc-2a18-45db-9c6b-22cf8e04e647 req-c45dd408-e4b9-494c-a965-c9a81911c290 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220026 Jul 25 12:20:55.521360 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 404/804] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:55.582180 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6f70081e-22ce-40c1-81e2-384a2a1d38f5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:55.582735 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-6f70081e-22ce-40c1-81e2-384a2a1d38f5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:55.589482 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f70081e-22ce-40c1-81e2-384a2a1d38f5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:55.590177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f70081e-22ce-40c1-81e2-384a2a1d38f5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:55.591018 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f70081e-22ce-40c1-81e2-384a2a1d38f5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:55.591640 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-6f70081e-22ce-40c1-81e2-384a2a1d38f5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:55.736304 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6f70081e-22ce-40c1-81e2-384a2a1d38f5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:55.754064 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6f70081e-22ce-40c1-81e2-384a2a1d38f5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:55.755733 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-6f70081e-22ce-40c1-81e2-384a2a1d38f5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:55.757150 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6f70081e-22ce-40c1-81e2-384a2a1d38f5 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1729 microversion: 2.20 time: 0.180058 Jul 25 12:20:55.761833 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 405/805] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:55 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:20:55.762551 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-da414939-5a62-4350-9159-2f04dea3f168 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:55.763296 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-da414939-5a62-4350-9159-2f04dea3f168 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:55.778966 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da414939-5a62-4350-9159-2f04dea3f168 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:55.779517 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da414939-5a62-4350-9159-2f04dea3f168 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:55.780507 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da414939-5a62-4350-9159-2f04dea3f168 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:55.780952 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da414939-5a62-4350-9159-2f04dea3f168 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:55.815681 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da414939-5a62-4350-9159-2f04dea3f168 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:55.816132 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-da414939-5a62-4350-9159-2f04dea3f168 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:55.816773 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-da414939-5a62-4350-9159-2f04dea3f168 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lazy-loading 'fault' on Instance uuid d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:20:55.869047 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-da414939-5a62-4350-9159-2f04dea3f168 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b98bbcc2d640de837d141f83dfe924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce78c16fa24c475b945a64a7995c70e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:55.889494 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-da414939-5a62-4350-9159-2f04dea3f168 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 200 len: 1326 microversion: 2.1 time: 0.129832 Jul 25 12:20:55.890318 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 406/806] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:55 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 1326 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:20:56.026735 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-86789163-dd88-4cde-83c3-ac8177b4f6fd tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "POST /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.644546 Jul 25 12:20:56.028020 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 401/807] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:20:55 2022] POST /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:20:56.781293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-09bfcee1-fffd-45bc-b874-a74f04e4a5c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:56.781988 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-09bfcee1-fffd-45bc-b874-a74f04e4a5c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:56.788498 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09bfcee1-fffd-45bc-b874-a74f04e4a5c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:56.788947 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09bfcee1-fffd-45bc-b874-a74f04e4a5c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:56.789700 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09bfcee1-fffd-45bc-b874-a74f04e4a5c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:56.790132 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-09bfcee1-fffd-45bc-b874-a74f04e4a5c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:56.914451 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-04169e18-0a28-4f4c-aa96-556342505239 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:56.915153 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-04169e18-0a28-4f4c-aa96-556342505239 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:56.917829 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-09bfcee1-fffd-45bc-b874-a74f04e4a5c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:56.921546 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-04169e18-0a28-4f4c-aa96-556342505239 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:56.921997 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-04169e18-0a28-4f4c-aa96-556342505239 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:56.922765 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-04169e18-0a28-4f4c-aa96-556342505239 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:56.923200 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-04169e18-0a28-4f4c-aa96-556342505239 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:56.926169 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-09bfcee1-fffd-45bc-b874-a74f04e4a5c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:56.927810 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-09bfcee1-fffd-45bc-b874-a74f04e4a5c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:20:56.928972 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-09bfcee1-fffd-45bc-b874-a74f04e4a5c7 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1716 microversion: 2.20 time: 0.151889 Jul 25 12:20:56.929529 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 407/808] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:20:56 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:20:56.936992 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-04169e18-0a28-4f4c-aa96-556342505239 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] HTTP exception thrown: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-04169e18-0a28-4f4c-aa96-556342505239 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Request method failure captured: Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 HTTP/1.1 Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3ok_DbuTRKK1ReZoZDULS3DEXCb4ZDORaGOFSZeUa09wwPmsFzAlhgebQxRVbm3v1R2NWqB6kAC7bpWmjIHjtpxfMhdw31oqG9qFAQM7-RgCkKKy8TJeUm_8Vz6vYWMCqBAT2Do01uIXFchd2gSmIroY1yZtNGOXldKLkOnN9QX2Aco Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: ce78c16fa24c475b945a64a7995c70e4 Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:20:56.938652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:20:56.940225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:20:56.940225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:20:56.940225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: ce78c16fa24c475b945a64a7995c70e4 Jul 25 12:20:56.940225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:20:56.940225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeTestJSON-866303580-project Jul 25 12:20:56.940225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:20:56.940225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:20:56.940225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: c5b98bbcc2d640de837d141f83dfe924 Jul 25 12:20:56.940225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeTestJSON-866303580-project Jul 25 12:20:56.940225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:20:56.940225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:56.940225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': 'd3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031'} Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:20:56.941112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:56.942662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:56.944056 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-04169e18-0a28-4f4c-aa96-556342505239 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Returning 404 to user: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:20:56.944056 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-04169e18-0a28-4f4c-aa96-556342505239 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 404 len: 111 microversion: 2.1 time: 0.030307 Jul 25 12:20:56.944056 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 402/809] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:56 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:20:56.949654 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4a7650b2-d5cb-40ff-b974-30b547a7729f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '.version_select at 0x7f942c280f70>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:56.968149 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4a7650b2-d5cb-40ff-b974-30b547a7729f tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-751287666" status: 202 len: 0 microversion: 2.1 time: 0.022771 Jul 25 12:20:56.968756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 408/810] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Jul 25 12:20:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-751287666 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:20:59.850171 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1f846967-84e8-424b-88cd-a39b7a29d229 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:59.850675 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1f846967-84e8-424b-88cd-a39b7a29d229 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:59.857337 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f846967-84e8-424b-88cd-a39b7a29d229 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:59.857786 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f846967-84e8-424b-88cd-a39b7a29d229 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:59.858543 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f846967-84e8-424b-88cd-a39b7a29d229 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:59.858979 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f846967-84e8-424b-88cd-a39b7a29d229 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:59.872264 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-1f846967-84e8-424b-88cd-a39b7a29d229 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] HTTP exception thrown: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1f846967-84e8-424b-88cd-a39b7a29d229 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Request method failure captured: Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 HTTP/1.1 Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3ok_DbuTRKK1ReZoZDULS3DEXCb4ZDORaGOFSZeUa09wwPmsFzAlhgebQxRVbm3v1R2NWqB6kAC7bpWmjIHjtpxfMhdw31oqG9qFAQM7-RgCkKKy8TJeUm_8Vz6vYWMCqBAT2Do01uIXFchd2gSmIroY1yZtNGOXldKLkOnN9QX2Aco Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: ce78c16fa24c475b945a64a7995c70e4 Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:20:59.873778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:20:59.875196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:20:59.875196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:20:59.875196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: ce78c16fa24c475b945a64a7995c70e4 Jul 25 12:20:59.875196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:20:59.875196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeTestJSON-866303580-project Jul 25 12:20:59.875196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:20:59.875196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:20:59.875196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: c5b98bbcc2d640de837d141f83dfe924 Jul 25 12:20:59.875196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeTestJSON-866303580-project Jul 25 12:20:59.875196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:20:59.875196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:59.875196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': 'd3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031'} Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:20:59.876008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:59.877185 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:20:59.878337 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1f846967-84e8-424b-88cd-a39b7a29d229 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Returning 404 to user: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:20:59.878337 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1f846967-84e8-424b-88cd-a39b7a29d229 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 404 len: 111 microversion: 2.1 time: 0.028825 Jul 25 12:20:59.878337 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 403/811] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:20:59 2022] DELETE /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:20:59.883438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ecd601b2-797e-44f8-802e-151932ffecc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:20:59.884080 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ecd601b2-797e-44f8-802e-151932ffecc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:20:59.890712 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ecd601b2-797e-44f8-802e-151932ffecc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:59.891157 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ecd601b2-797e-44f8-802e-151932ffecc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:59.891941 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ecd601b2-797e-44f8-802e-151932ffecc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:20:59.892373 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ecd601b2-797e-44f8-802e-151932ffecc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:20:59.906230 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-ecd601b2-797e-44f8-802e-151932ffecc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] HTTP exception thrown: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ecd601b2-797e-44f8-802e-151932ffecc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Request method failure captured: Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 HTTP/1.1 Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3ok_DbuTRKK1ReZoZDULS3DEXCb4ZDORaGOFSZeUa09wwPmsFzAlhgebQxRVbm3v1R2NWqB6kAC7bpWmjIHjtpxfMhdw31oqG9qFAQM7-RgCkKKy8TJeUm_8Vz6vYWMCqBAT2Do01uIXFchd2gSmIroY1yZtNGOXldKLkOnN9QX2Aco Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: ce78c16fa24c475b945a64a7995c70e4 Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:20:59.907879 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:20:59.909423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:20:59.909423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:20:59.909423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: ce78c16fa24c475b945a64a7995c70e4 Jul 25 12:20:59.909423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:20:59.909423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeTestJSON-866303580-project Jul 25 12:20:59.909423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:20:59.909423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:20:59.909423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: c5b98bbcc2d640de837d141f83dfe924 Jul 25 12:20:59.909423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeTestJSON-866303580-project Jul 25 12:20:59.909423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:20:59.909423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:59.909423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': 'd3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031'} Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:20:59.910279 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. Jul 25 12:20:59.911741 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:20:59.912995 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ecd601b2-797e-44f8-802e-151932ffecc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Returning 404 to user: Instance d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:20:59.912995 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ecd601b2-797e-44f8-802e-151932ffecc2 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031" status: 404 len: 111 microversion: 2.1 time: 0.029632 Jul 25 12:20:59.912995 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 409/812] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:20:59 2022] GET /compute/v2.1/servers/d3d63a7a-e3a5-4eaf-b0ef-fdf69d67d031 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:21:01.046398 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-854f9a25-bf2f-43e2-b1b2-28d771dd0fa6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:01.046897 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-854f9a25-bf2f-43e2-b1b2-28d771dd0fa6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:01.053469 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-854f9a25-bf2f-43e2-b1b2-28d771dd0fa6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:01.053916 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-854f9a25-bf2f-43e2-b1b2-28d771dd0fa6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:01.054679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-854f9a25-bf2f-43e2-b1b2-28d771dd0fa6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:01.055116 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-854f9a25-bf2f-43e2-b1b2-28d771dd0fa6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:01.068722 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-854f9a25-bf2f-43e2-b1b2-28d771dd0fa6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] HTTP exception thrown: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-854f9a25-bf2f-43e2-b1b2-28d771dd0fa6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Request method failure captured: Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 HTTP/1.1 Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3ok_DbuTRKK1ReZoZDULS3DEXCb4ZDORaGOFSZeUa09wwPmsFzAlhgebQxRVbm3v1R2NWqB6kAC7bpWmjIHjtpxfMhdw31oqG9qFAQM7-RgCkKKy8TJeUm_8Vz6vYWMCqBAT2Do01uIXFchd2gSmIroY1yZtNGOXldKLkOnN9QX2Aco Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: ce78c16fa24c475b945a64a7995c70e4 Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:21:01.070239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:21:01.071713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:01.071713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:21:01.071713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: ce78c16fa24c475b945a64a7995c70e4 Jul 25 12:21:01.071713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:21:01.071713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeTestJSON-866303580-project Jul 25 12:21:01.071713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:21:01.071713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:21:01.071713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: c5b98bbcc2d640de837d141f83dfe924 Jul 25 12:21:01.071713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeTestJSON-866303580-project Jul 25 12:21:01.071713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:21:01.071713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:21:01.071713 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': '8ea750ca-a1eb-4a15-ad78-dddfc62d8d13'} Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:01.072688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:21:01.074088 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:01.075488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-854f9a25-bf2f-43e2-b1b2-28d771dd0fa6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Returning 404 to user: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:01.075488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-854f9a25-bf2f-43e2-b1b2-28d771dd0fa6 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 404 len: 111 microversion: 2.1 time: 0.029084 Jul 25 12:21:01.075488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 404/813] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:21:01 2022] DELETE /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:21:01.079940 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-db8b7eaa-2a3e-46d7-938d-7b76c74fda33 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:01.080550 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-db8b7eaa-2a3e-46d7-938d-7b76c74fda33 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] [instance: 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:01.086906 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-db8b7eaa-2a3e-46d7-938d-7b76c74fda33 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:01.087349 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-db8b7eaa-2a3e-46d7-938d-7b76c74fda33 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:01.088124 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-db8b7eaa-2a3e-46d7-938d-7b76c74fda33 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:01.088553 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-db8b7eaa-2a3e-46d7-938d-7b76c74fda33 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:01.101801 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-db8b7eaa-2a3e-46d7-938d-7b76c74fda33 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] HTTP exception thrown: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-db8b7eaa-2a3e-46d7-938d-7b76c74fda33 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Request method failure captured: Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 HTTP/1.1 Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3ok_DbuTRKK1ReZoZDULS3DEXCb4ZDORaGOFSZeUa09wwPmsFzAlhgebQxRVbm3v1R2NWqB6kAC7bpWmjIHjtpxfMhdw31oqG9qFAQM7-RgCkKKy8TJeUm_8Vz6vYWMCqBAT2Do01uIXFchd2gSmIroY1yZtNGOXldKLkOnN9QX2Aco Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: ce78c16fa24c475b945a64a7995c70e4 Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:21:01.103834 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:21:01.105675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ce78c16fa24c475b945a64a7995c70e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:01.105675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:21:01.105675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: ce78c16fa24c475b945a64a7995c70e4 Jul 25 12:21:01.105675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeTestJSON-866303580 Jul 25 12:21:01.105675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeTestJSON-866303580-project Jul 25 12:21:01.105675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:21:01.105675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:21:01.105675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: c5b98bbcc2d640de837d141f83dfe924 Jul 25 12:21:01.105675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeTestJSON-866303580-project Jul 25 12:21:01.105675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:21:01.105675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:21:01.105675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '8ea750ca-a1eb-4a15-ad78-dddfc62d8d13'} Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:01.106547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. Jul 25 12:21:01.108021 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:01.109271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-db8b7eaa-2a3e-46d7-938d-7b76c74fda33 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] Returning 404 to user: Instance 8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:01.109271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-db8b7eaa-2a3e-46d7-938d-7b76c74fda33 tempest-AttachVolumeTestJSON-866303580 tempest-AttachVolumeTestJSON-866303580-project] 10.222.0.42 "GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13" status: 404 len: 111 microversion: 2.1 time: 0.029120 Jul 25 12:21:01.109271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 410/814] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:21:01 2022] GET /compute/v2.1/servers/8ea750ca-a1eb-4a15-ad78-dddfc62d8d13 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:21:02.640482 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-517e20c8-df74-4573-8b03-5b36bdc8e0dc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:02.640981 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-517e20c8-df74-4573-8b03-5b36bdc8e0dc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:02.647701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-517e20c8-df74-4573-8b03-5b36bdc8e0dc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:02.648144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-517e20c8-df74-4573-8b03-5b36bdc8e0dc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:02.649615 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-517e20c8-df74-4573-8b03-5b36bdc8e0dc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:02.650042 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-517e20c8-df74-4573-8b03-5b36bdc8e0dc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:02.742638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-517e20c8-df74-4573-8b03-5b36bdc8e0dc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lazy-loading 'services' on Instance uuid f5c6ab49-d845-4c1d-80ce-32c24c25ed6d {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:21:02.824531 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-517e20c8-df74-4573-8b03-5b36bdc8e0dc tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d/os-volume_attachments/ea1896f1-0543-4afc-9f51-2ac74a649a39" status: 202 len: 0 microversion: 2.1 time: 0.188108 Jul 25 12:21:02.825451 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 405/815] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Jul 25 12:21:02 2022] DELETE /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d/os-volume_attachments/ea1896f1-0543-4afc-9f51-2ac74a649a39 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:21:02.843224 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2bb5df30-8db0-46c5-8aad-970beac03f8d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:02.848408 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2bb5df30-8db0-46c5-8aad-970beac03f8d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:02.861572 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2bb5df30-8db0-46c5-8aad-970beac03f8d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:02.862029 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2bb5df30-8db0-46c5-8aad-970beac03f8d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:02.862807 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2bb5df30-8db0-46c5-8aad-970beac03f8d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:02.863243 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2bb5df30-8db0-46c5-8aad-970beac03f8d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:02.924255 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2bb5df30-8db0-46c5-8aad-970beac03f8d tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092850 Jul 25 12:21:02.938587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 411/816] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:21:02 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:21:03.946322 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-56c78122-1c2d-4169-9e34-8135b4bbbd93 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:03.949390 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-56c78122-1c2d-4169-9e34-8135b4bbbd93 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:03.957181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56c78122-1c2d-4169-9e34-8135b4bbbd93 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:03.958462 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56c78122-1c2d-4169-9e34-8135b4bbbd93 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:03.960028 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56c78122-1c2d-4169-9e34-8135b4bbbd93 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:03.960028 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-56c78122-1c2d-4169-9e34-8135b4bbbd93 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:04.005319 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-56c78122-1c2d-4169-9e34-8135b4bbbd93 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063967 Jul 25 12:21:04.006204 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 406/817] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Jul 25 12:21:03 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:21:04.097787 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d256c2e8-2342-442a-9b45-0ca68f47bc42 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:04.098799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d256c2e8-2342-442a-9b45-0ca68f47bc42 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:04.107047 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d256c2e8-2342-442a-9b45-0ca68f47bc42 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:04.107707 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d256c2e8-2342-442a-9b45-0ca68f47bc42 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:04.109700 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d256c2e8-2342-442a-9b45-0ca68f47bc42 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:04.110294 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d256c2e8-2342-442a-9b45-0ca68f47bc42 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:04.140075 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d256c2e8-2342-442a-9b45-0ca68f47bc42 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:21:04.285173 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d256c2e8-2342-442a-9b45-0ca68f47bc42 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 204 len: 0 microversion: 2.1 time: 0.189910 Jul 25 12:21:04.287312 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 412/818] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:21:04 2022] DELETE /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:21:04.297326 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-40864e9b-44f3-4426-891f-dae5338dd771 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:04.298199 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-40864e9b-44f3-4426-891f-dae5338dd771 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:04.305412 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-40864e9b-44f3-4426-891f-dae5338dd771 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:04.306044 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-40864e9b-44f3-4426-891f-dae5338dd771 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:04.307662 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-40864e9b-44f3-4426-891f-dae5338dd771 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:04.308264 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-40864e9b-44f3-4426-891f-dae5338dd771 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:04.575466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-40864e9b-44f3-4426-891f-dae5338dd771 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:04.593445 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-40864e9b-44f3-4426-891f-dae5338dd771 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1681 microversion: 2.1 time: 0.300555 Jul 25 12:21:04.610196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 407/819] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:21:04 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1681 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:21:05.618476 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ef183fd7-8e04-48b5-b607-ff973284e382 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:05.619361 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ef183fd7-8e04-48b5-b607-ff973284e382 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:05.626808 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef183fd7-8e04-48b5-b607-ff973284e382 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:05.630729 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef183fd7-8e04-48b5-b607-ff973284e382 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:05.632785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef183fd7-8e04-48b5-b607-ff973284e382 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:05.633247 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ef183fd7-8e04-48b5-b607-ff973284e382 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:05.771320 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ef183fd7-8e04-48b5-b607-ff973284e382 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:05.796369 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ef183fd7-8e04-48b5-b607-ff973284e382 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1681 microversion: 2.1 time: 0.182634 Jul 25 12:21:05.796942 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 413/820] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:21:05 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:21:06.805581 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-c4edb287-e732-4b16-a3a0-e5641998c112 req-1e66d242-c2a6-4d5d-8ff1-04d974173e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c6ab49-d845-4c1d-80ce-32c24c25ed6d", "name": "network-vif-deleted", "tag": "276cabbe-91f0-4792-85c7-8ae931f21975"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:21:06.826104 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-eb22c937-be1a-4688-a1a8-ae3179bf8175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:06.826790 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-eb22c937-be1a-4688-a1a8-ae3179bf8175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:06.836334 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-c4edb287-e732-4b16-a3a0-e5641998c112 req-1e66d242-c2a6-4d5d-8ff1-04d974173e03 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:06.838643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eb22c937-be1a-4688-a1a8-ae3179bf8175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:06.839273 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eb22c937-be1a-4688-a1a8-ae3179bf8175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:06.840394 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-c4edb287-e732-4b16-a3a0-e5641998c112 req-1e66d242-c2a6-4d5d-8ff1-04d974173e03 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:06.842522 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eb22c937-be1a-4688-a1a8-ae3179bf8175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:06.843090 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eb22c937-be1a-4688-a1a8-ae3179bf8175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:06.866985 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-c4edb287-e732-4b16-a3a0-e5641998c112 req-1e66d242-c2a6-4d5d-8ff1-04d974173e03 service nova] Creating event network-vif-deleted:276cabbe-91f0-4792-85c7-8ae931f21975 for instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d on hv-cinder-79760 Jul 25 12:21:06.877954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:06.879799 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-c4edb287-e732-4b16-a3a0-e5641998c112 req-1e66d242-c2a6-4d5d-8ff1-04d974173e03 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072991 Jul 25 12:21:06.885390 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 408/821] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:21:06.937536 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-eb22c937-be1a-4688-a1a8-ae3179bf8175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3848eae5b8df48eb9816ba0d7485f7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ff6cbb1ad04f0faa8b2ed2a66cdca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:06.956675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-eb22c937-be1a-4688-a1a8-ae3179bf8175 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 200 len: 1326 microversion: 2.1 time: 0.141631 Jul 25 12:21:06.960609 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 414/822] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:21:06 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 1326 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:21:07.979329 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7a0bcf93-c7bc-4eed-96dd-d93b44f3815a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:07.980092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7a0bcf93-c7bc-4eed-96dd-d93b44f3815a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:07.989086 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7a0bcf93-c7bc-4eed-96dd-d93b44f3815a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:07.989255 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7a0bcf93-c7bc-4eed-96dd-d93b44f3815a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:07.989948 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7a0bcf93-c7bc-4eed-96dd-d93b44f3815a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:07.990389 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7a0bcf93-c7bc-4eed-96dd-d93b44f3815a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:08.007424 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-7a0bcf93-c7bc-4eed-96dd-d93b44f3815a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7a0bcf93-c7bc-4eed-96dd-d93b44f3815a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d HTTP/1.1 Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:21:08.009666 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:21:08.011203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:08.011203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:08.011203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:08.011203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:08.011203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:08.011203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:21:08.011203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:21:08.011203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:21:08.011203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:08.011203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:21:08.011203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:08.011203 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': 'f5c6ab49-d845-4c1d-80ce-32c24c25ed6d'} Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:08.011955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:08.013135 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:08.014244 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7a0bcf93-c7bc-4eed-96dd-d93b44f3815a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 404 to user: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:08.014244 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7a0bcf93-c7bc-4eed-96dd-d93b44f3815a tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 404 len: 111 microversion: 2.1 time: 0.036823 Jul 25 12:21:08.014244 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 409/823] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:21:07 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:21:08.020572 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ffd68a37-3ce3-4fb3-9156-0b18b9011079 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '.version_select at 0x7f942c395a60>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:08.043292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ffd68a37-3ce3-4fb3-9156-0b18b9011079 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-834412666" status: 202 len: 0 microversion: 2.1 time: 0.026598 Jul 25 12:21:08.044007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 415/824] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Jul 25 12:21:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-834412666 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:21:09.821258 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-38e1aefb-cf40-4a8b-93f1-8802af525d3c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:09.821759 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-38e1aefb-cf40-4a8b-93f1-8802af525d3c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:09.828569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38e1aefb-cf40-4a8b-93f1-8802af525d3c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:09.829079 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38e1aefb-cf40-4a8b-93f1-8802af525d3c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:09.829796 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38e1aefb-cf40-4a8b-93f1-8802af525d3c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:09.830504 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38e1aefb-cf40-4a8b-93f1-8802af525d3c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:09.844501 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-38e1aefb-cf40-4a8b-93f1-8802af525d3c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-38e1aefb-cf40-4a8b-93f1-8802af525d3c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d HTTP/1.1 Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:21:09.846047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:21:09.847525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:09.847525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:09.847525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:09.847525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:09.847525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:09.847525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:21:09.847525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:21:09.847525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:21:09.847525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:09.847525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:21:09.847525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:09.847525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': 'f5c6ab49-d845-4c1d-80ce-32c24c25ed6d'} Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:09.848523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:09.850144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:09.851847 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-38e1aefb-cf40-4a8b-93f1-8802af525d3c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 404 to user: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:09.851847 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-38e1aefb-cf40-4a8b-93f1-8802af525d3c tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 404 len: 111 microversion: 2.1 time: 0.030010 Jul 25 12:21:09.851847 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 410/825] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:21:09 2022] DELETE /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:21:09.862773 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-08219ae1-501f-4e39-b956-7a15ce2bd3d6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:09.865993 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-08219ae1-501f-4e39-b956-7a15ce2bd3d6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: f5c6ab49-d845-4c1d-80ce-32c24c25ed6d] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:09.875447 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08219ae1-501f-4e39-b956-7a15ce2bd3d6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:09.880754 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08219ae1-501f-4e39-b956-7a15ce2bd3d6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:09.881973 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08219ae1-501f-4e39-b956-7a15ce2bd3d6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:09.882486 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-08219ae1-501f-4e39-b956-7a15ce2bd3d6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:09.902115 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-08219ae1-501f-4e39-b956-7a15ce2bd3d6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-08219ae1-501f-4e39-b956-7a15ce2bd3d6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d HTTP/1.1 Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:21:09.903816 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:21:09.905367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:09.905367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:09.905367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:09.905367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:09.905367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:09.905367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:21:09.905367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:21:09.905367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:21:09.905367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:09.905367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:21:09.905367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:09.905367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': 'f5c6ab49-d845-4c1d-80ce-32c24c25ed6d'} Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:09.906196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. Jul 25 12:21:09.907669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:09.908892 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-08219ae1-501f-4e39-b956-7a15ce2bd3d6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 404 to user: Instance f5c6ab49-d845-4c1d-80ce-32c24c25ed6d could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:09.908892 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-08219ae1-501f-4e39-b956-7a15ce2bd3d6 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d" status: 404 len: 111 microversion: 2.1 time: 0.050185 Jul 25 12:21:09.908892 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 416/826] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:21:09 2022] GET /compute/v2.1/servers/f5c6ab49-d845-4c1d-80ce-32c24c25ed6d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:21:11.062214 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3daf932b-7bb3-4a4b-8abb-d9460aa9f541 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:11.063224 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3daf932b-7bb3-4a4b-8abb-d9460aa9f541 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:11.071333 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3daf932b-7bb3-4a4b-8abb-d9460aa9f541 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:11.071908 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3daf932b-7bb3-4a4b-8abb-d9460aa9f541 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:11.072564 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3daf932b-7bb3-4a4b-8abb-d9460aa9f541 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:11.072992 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3daf932b-7bb3-4a4b-8abb-d9460aa9f541 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:11.089108 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-3daf932b-7bb3-4a4b-8abb-d9460aa9f541 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3daf932b-7bb3-4a4b-8abb-d9460aa9f541 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f HTTP/1.1 Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:21:11.090803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:21:11.092324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:11.092324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:11.092324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:11.092324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:11.092324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:11.092324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:21:11.092324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:21:11.092324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:21:11.092324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:11.092324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:21:11.092324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:21:11.092324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': '6cf2bada-8518-4f83-8d6b-abe45ffe638f'} Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:11.093181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:21:11.094679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.096458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3daf932b-7bb3-4a4b-8abb-d9460aa9f541 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 404 to user: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:11.096458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3daf932b-7bb3-4a4b-8abb-d9460aa9f541 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 404 len: 111 microversion: 2.1 time: 0.033962 Jul 25 12:21:11.096458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 411/827] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:21:11 2022] DELETE /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:21:11.101029 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d1b0480c-172f-4d5b-8a6d-940a7948daba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:11.101738 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d1b0480c-172f-4d5b-8a6d-940a7948daba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 6cf2bada-8518-4f83-8d6b-abe45ffe638f] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:11.109113 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1b0480c-172f-4d5b-8a6d-940a7948daba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:11.109566 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1b0480c-172f-4d5b-8a6d-940a7948daba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:11.110347 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1b0480c-172f-4d5b-8a6d-940a7948daba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:11.110780 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d1b0480c-172f-4d5b-8a6d-940a7948daba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:11.124535 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-d1b0480c-172f-4d5b-8a6d-940a7948daba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d1b0480c-172f-4d5b-8a6d-940a7948daba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f HTTP/1.1 Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:21:11.126131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:21:11.127714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:11.127714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:11.127714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:11.127714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:11.127714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:11.127714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:21:11.127714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:21:11.127714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:21:11.127714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:11.127714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:21:11.127714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:21:11.127714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '6cf2bada-8518-4f83-8d6b-abe45ffe638f'} Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:11.128603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. Jul 25 12:21:11.130019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.131357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d1b0480c-172f-4d5b-8a6d-940a7948daba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 404 to user: Instance 6cf2bada-8518-4f83-8d6b-abe45ffe638f could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:11.131357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d1b0480c-172f-4d5b-8a6d-940a7948daba tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f" status: 404 len: 111 microversion: 2.1 time: 0.030531 Jul 25 12:21:11.131357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 417/828] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:21:11 2022] GET /compute/v2.1/servers/6cf2bada-8518-4f83-8d6b-abe45ffe638f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:21:11.136290 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d7770052-22c9-4c25-8f1d-5f0a81150287 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:11.136781 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d7770052-22c9-4c25-8f1d-5f0a81150287 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:11.142766 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7770052-22c9-4c25-8f1d-5f0a81150287 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:11.143208 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7770052-22c9-4c25-8f1d-5f0a81150287 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:11.143991 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7770052-22c9-4c25-8f1d-5f0a81150287 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:11.144461 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d7770052-22c9-4c25-8f1d-5f0a81150287 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:11.158861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-d7770052-22c9-4c25-8f1d-5f0a81150287 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d7770052-22c9-4c25-8f1d-5f0a81150287 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 HTTP/1.1 Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:21:11.160429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:21:11.161750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:11.161750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:11.161750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:11.161750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:11.161750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:11.161750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:21:11.161750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:21:11.161750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:21:11.161750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:11.161750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:21:11.161750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:21:11.161750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': '484cf6bc-2993-476c-ab86-45ac7e109720'} Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:11.166500 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:21:11.167959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.169111 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d7770052-22c9-4c25-8f1d-5f0a81150287 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 404 to user: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:11.169111 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d7770052-22c9-4c25-8f1d-5f0a81150287 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 404 len: 111 microversion: 2.1 time: 0.029393 Jul 25 12:21:11.169111 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 412/829] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:21:11 2022] DELETE /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:21:11.171289 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-eaa92c4d-ea19-44e8-9ee2-40913eb497e5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:11.171454 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-eaa92c4d-ea19-44e8-9ee2-40913eb497e5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 484cf6bc-2993-476c-ab86-45ac7e109720] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:11.177385 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eaa92c4d-ea19-44e8-9ee2-40913eb497e5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:11.177824 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eaa92c4d-ea19-44e8-9ee2-40913eb497e5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:11.178573 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eaa92c4d-ea19-44e8-9ee2-40913eb497e5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:11.179001 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-eaa92c4d-ea19-44e8-9ee2-40913eb497e5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:11.192412 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-eaa92c4d-ea19-44e8-9ee2-40913eb497e5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-eaa92c4d-ea19-44e8-9ee2-40913eb497e5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 HTTP/1.1 Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:21:11.193955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:21:11.195785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:11.195785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:11.195785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:11.195785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:11.195785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:11.195785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:21:11.195785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:21:11.195785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:21:11.195785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:11.195785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:21:11.195785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:21:11.195785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '484cf6bc-2993-476c-ab86-45ac7e109720'} Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:11.196768 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. Jul 25 12:21:11.198345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:11.199777 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-eaa92c4d-ea19-44e8-9ee2-40913eb497e5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 404 to user: Instance 484cf6bc-2993-476c-ab86-45ac7e109720 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:11.199777 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-eaa92c4d-ea19-44e8-9ee2-40913eb497e5 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720" status: 404 len: 111 microversion: 2.1 time: 0.028235 Jul 25 12:21:11.199777 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 418/830] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:21:11 2022] GET /compute/v2.1/servers/484cf6bc-2993-476c-ab86-45ac7e109720 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:21:12.361463 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cc4d39f0-c1e6-4495-a697-283359ddae74 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:12.361959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cc4d39f0-c1e6-4495-a697-283359ddae74 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:12.368872 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc4d39f0-c1e6-4495-a697-283359ddae74 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:12.369321 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc4d39f0-c1e6-4495-a697-283359ddae74 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:12.370086 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc4d39f0-c1e6-4495-a697-283359ddae74 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:12.370528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cc4d39f0-c1e6-4495-a697-283359ddae74 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:12.384733 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-cc4d39f0-c1e6-4495-a697-283359ddae74 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cc4d39f0-c1e6-4495-a697-283359ddae74 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e HTTP/1.1 Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:21:12.386289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:21:12.387804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:12.387804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:12.387804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:12.387804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:12.387804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:12.387804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:21:12.387804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:21:12.387804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:21:12.387804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:12.387804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:21:12.387804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:21:12.387804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': '3d50aae7-fb06-467c-9a21-1d683297bc9e'} Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:12.388525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:21:12.389701 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:12.390890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cc4d39f0-c1e6-4495-a697-283359ddae74 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 404 to user: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:12.390890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cc4d39f0-c1e6-4495-a697-283359ddae74 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 404 len: 111 microversion: 2.1 time: 0.030063 Jul 25 12:21:12.390890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 413/831] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:21:12 2022] DELETE /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:21:12.396984 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8cbfc86e-5ec8-4f2a-879c-da100adc1259 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:12.397603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8cbfc86e-5ec8-4f2a-879c-da100adc1259 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] [instance: 3d50aae7-fb06-467c-9a21-1d683297bc9e] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:12.405223 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8cbfc86e-5ec8-4f2a-879c-da100adc1259 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:12.405660 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8cbfc86e-5ec8-4f2a-879c-da100adc1259 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:12.406407 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8cbfc86e-5ec8-4f2a-879c-da100adc1259 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:12.406829 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8cbfc86e-5ec8-4f2a-879c-da100adc1259 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:12.423501 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-8cbfc86e-5ec8-4f2a-879c-da100adc1259 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] HTTP exception thrown: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8cbfc86e-5ec8-4f2a-879c-da100adc1259 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Request method failure captured: Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e HTTP/1.1 Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3olAsqdMbDIN6SfoQ-Q8WIpWC8ff-usb-S2ZqaZFlJApctsfA3fdDHObxqkeIbK4U22zzG-oS_MEH1diPCWHnMBmE3f727zH_rXph6SIzRzpBJ0x8quJzsWerHHvoKwAOmR7EYgUyignJ6aMDIgB9h6AbSmNr53OQ6HJXJzV5H2EnJU Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:21:12.425072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:21:12.426756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11ff6cbb1ad04f0faa8b2ed2a66cdca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:12.426756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:12.426756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 11ff6cbb1ad04f0faa8b2ed2a66cdca4 Jul 25 12:21:12.426756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630165615 Jul 25 12:21:12.426756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:12.426756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:21:12.426756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:21:12.426756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 3848eae5b8df48eb9816ba0d7485f7c0 Jul 25 12:21:12.426756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeNegativeTest-1630165615-project Jul 25 12:21:12.426756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:21:12.426756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:21:12.426756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '3d50aae7-fb06-467c-9a21-1d683297bc9e'} Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:12.427723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. Jul 25 12:21:12.429196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:12.430495 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8cbfc86e-5ec8-4f2a-879c-da100adc1259 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] Returning 404 to user: Instance 3d50aae7-fb06-467c-9a21-1d683297bc9e could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:12.430495 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8cbfc86e-5ec8-4f2a-879c-da100adc1259 tempest-AttachVolumeNegativeTest-1630165615 tempest-AttachVolumeNegativeTest-1630165615-project] 10.222.0.42 "GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e" status: 404 len: 111 microversion: 2.1 time: 0.033738 Jul 25 12:21:12.430495 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 419/832] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:21:12 2022] GET /compute/v2.1/servers/3d50aae7-fb06-467c-9a21-1d683297bc9e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:21:17.148926 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-aab2f5c4-7299-4d52-8828-d87314f38361 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Action: 'create', calling method: .version_select at 0x7f942c169310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1812499207", "metadata": {"Type": "work"}}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-aab2f5c4-7299-4d52-8828-d87314f38361 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Request method failure captured: Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 122 Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3oq8_8xw0TGRi1dqw6ygTSPc0CuUpFNFUFPYNOX44OzLIOXjcSOfZ3tczyABSrTpT6a-R8Y8KSLBbwVS196uNHI4eCJs81KVMfSxRElmcorBiZIznddbFBrxEGwOUhfzCXv85X8pDh5fzwkgpCuLO0fZmt7vkCdR8ic2VVX81h32uiI Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 7deb5e10b1a84db5bb34b6059fff861c Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:21:17.160804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:21:17.162173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:17.162173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.162173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 7deb5e10b1a84db5bb34b6059fff861c Jul 25 12:21:17.162173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.162173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesNegativeTest-1940499370-project Jul 25 12:21:17.162173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:21:17.162173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:21:17.162173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 7c6602c69fad4e86a96e4c2843c4f5f7 Jul 25 12:21:17.162173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesNegativeTest-1940499370-project Jul 25 12:21:17.162173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Jul 25 12:21:17.162173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1812499207", "metadata": {"Type": "work"}}} Jul 25 12:21:17.162173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: Jul 25 12:21:17.162173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1812499207', 'metadata': {'Type': 'work'}}}} Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:17.163092 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:21:17.165890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:21:17.167345 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 12:21:17.167345 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.167345 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-aab2f5c4-7299-4d52-8828-d87314f38361 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:17.167345 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-aab2f5c4-7299-4d52-8828-d87314f38361 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.135255 Jul 25 12:21:17.167345 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 414/833] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Jul 25 12:21:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:21:17.172922 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e9f22640-acf4-45da-8fca-b5e5bf990ce3 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Action: 'create', calling method: .version_select at 0x7f942c304a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1031719840", "metadata": {"Type": "work"}}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e9f22640-acf4-45da-8fca-b5e5bf990ce3 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Request method failure captured: Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 120 Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3oq8_8xw0TGRi1dqw6ygTSPc0CuUpFNFUFPYNOX44OzLIOXjcSOfZ3tczyABSrTpT6a-R8Y8KSLBbwVS196uNHI4eCJs81KVMfSxRElmcorBiZIznddbFBrxEGwOUhfzCXv85X8pDh5fzwkgpCuLO0fZmt7vkCdR8ic2VVX81h32uiI Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 7deb5e10b1a84db5bb34b6059fff861c Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:21:17.177466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:21:17.180068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:17.180068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.180068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 7deb5e10b1a84db5bb34b6059fff861c Jul 25 12:21:17.180068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.180068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesNegativeTest-1940499370-project Jul 25 12:21:17.180068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:21:17.180068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:21:17.180068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 7c6602c69fad4e86a96e4c2843c4f5f7 Jul 25 12:21:17.180068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesNegativeTest-1940499370-project Jul 25 12:21:17.180068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Jul 25 12:21:17.180068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1031719840", "metadata": {"Type": "work"}}} Jul 25 12:21:17.180068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: Jul 25 12:21:17.180068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1031719840', 'metadata': {'Type': 'work'}}}} Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi '0' Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:17.181468 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:21:17.183232 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:21:17.184797 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 12:21:17.184797 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.184797 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e9f22640-acf4-45da-8fca-b5e5bf990ce3 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:17.184797 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e9f22640-acf4-45da-8fca-b5e5bf990ce3 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010453 Jul 25 12:21:17.184797 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 420/834] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Jul 25 12:21:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 12:21:17.190192 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-543227da-0e9b-473a-8f2b-f2fc4e86e99a tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Action: 'create', calling method: .version_select at 0x7f942c0dc430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-917705513", "metadata": {"Type": "work"}}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-543227da-0e9b-473a-8f2b-f2fc4e86e99a tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Request method failure captured: Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 118 Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3oq8_8xw0TGRi1dqw6ygTSPc0CuUpFNFUFPYNOX44OzLIOXjcSOfZ3tczyABSrTpT6a-R8Y8KSLBbwVS196uNHI4eCJs81KVMfSxRElmcorBiZIznddbFBrxEGwOUhfzCXv85X8pDh5fzwkgpCuLO0fZmt7vkCdR8ic2VVX81h32uiI Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 7deb5e10b1a84db5bb34b6059fff861c Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:21:17.194780 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:21:17.196452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:17.196452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.196452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 7deb5e10b1a84db5bb34b6059fff861c Jul 25 12:21:17.196452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.196452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesNegativeTest-1940499370-project Jul 25 12:21:17.196452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:21:17.196452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:21:17.196452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 7c6602c69fad4e86a96e4c2843c4f5f7 Jul 25 12:21:17.196452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesNegativeTest-1940499370-project Jul 25 12:21:17.196452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Jul 25 12:21:17.196452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-917705513", "metadata": {"Type": "work"}}} Jul 25 12:21:17.196452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: Jul 25 12:21:17.196452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-917705513', 'metadata': {'Type': 'work'}}}} Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi '' Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:17.197825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:21:17.199354 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:21:17.200937 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 12:21:17.200937 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.200937 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-543227da-0e9b-473a-8f2b-f2fc4e86e99a tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:17.200937 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-543227da-0e9b-473a-8f2b-f2fc4e86e99a tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009896 Jul 25 12:21:17.200937 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 415/835] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Jul 25 12:21:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:21:17.207772 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9d2bd554-66e1-4e54-b30b-67338cd555dc tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Calling method '.version_select at 0x7f942c290c10>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:17.239890 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-9d2bd554-66e1-4e54-b30b-67338cd555dc tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] HTTP exception thrown: Volume tempest-invalid-1848176408 could not be found. Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9d2bd554-66e1-4e54-b30b-67338cd555dc tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Request method failure captured: Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1848176408 HTTP/1.1 Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3oq8_8xw0TGRi1dqw6ygTSPc0CuUpFNFUFPYNOX44OzLIOXjcSOfZ3tczyABSrTpT6a-R8Y8KSLBbwVS196uNHI4eCJs81KVMfSxRElmcorBiZIznddbFBrxEGwOUhfzCXv85X8pDh5fzwkgpCuLO0fZmt7vkCdR8ic2VVX81h32uiI Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 7deb5e10b1a84db5bb34b6059fff861c Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:21:17.242013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:21:17.243944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:17.243944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.243944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 7deb5e10b1a84db5bb34b6059fff861c Jul 25 12:21:17.243944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.243944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesNegativeTest-1940499370-project Jul 25 12:21:17.243944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:21:17.243944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:21:17.243944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 7c6602c69fad4e86a96e4c2843c4f5f7 Jul 25 12:21:17.243944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesNegativeTest-1940499370-project Jul 25 12:21:17.243944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: Jul 25 12:21:17.243944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Volume tempest-invalid-1848176408 could not be found. Jul 25 12:21:17.243944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': 'tempest-invalid-1848176408'} Jul 25 12:21:17.243944 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1848176408 could not be found. (HTTP 404) (Request-ID: req-ecad39a3-fa8d-436b-be80-40e6f6162931) Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.245161 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 12:21:17.246769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1848176408 could not be found. Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:17.249028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1848176408 could not be found. Jul 25 12:21:17.251657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.251657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.251657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.251657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.251657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:17.251657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:17.251657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:17.251657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:17.251657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1848176408 could not be found. Jul 25 12:21:17.251657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.251657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9d2bd554-66e1-4e54-b30b-67338cd555dc tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Returning 404 to user: Volume tempest-invalid-1848176408 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:17.251657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9d2bd554-66e1-4e54-b30b-67338cd555dc tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1848176408" status: 404 len: 99 microversion: 2.1 time: 0.040103 Jul 25 12:21:17.251657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 421/836] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Jul 25 12:21:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1848176408 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:21:17.255177 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3f89eaba-564a-4844-8614-f7950f4a5414 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004816 Jul 25 12:21:17.255695 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 416/837] 10.222.0.42 () {58 vars in 1140 bytes} [Mon Jul 25 12:21:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 12:21:17.280063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b1441f64-9f43-4aed-afd4-55684d367e0c tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.018842 Jul 25 12:21:17.282913 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 422/838] 10.222.0.42 () {58 vars in 1137 bytes} [Mon Jul 25 12:21:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 12:21:17.294435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fb9a5060-9159-4cea-a396-e4196a3629c6 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Calling method '.version_select at 0x7f942c1719d0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:17.340544 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-fb9a5060-9159-4cea-a396-e4196a3629c6 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] HTTP exception thrown: Volume 94dfd83a-53bf-4846-95a3-e27260e487d8 could not be found. Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fb9a5060-9159-4cea-a396-e4196a3629c6 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Request method failure captured: Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/os-volumes/94dfd83a-53bf-4846-95a3-e27260e487d8 HTTP/1.1 Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3oq8_8xw0TGRi1dqw6ygTSPc0CuUpFNFUFPYNOX44OzLIOXjcSOfZ3tczyABSrTpT6a-R8Y8KSLBbwVS196uNHI4eCJs81KVMfSxRElmcorBiZIznddbFBrxEGwOUhfzCXv85X8pDh5fzwkgpCuLO0fZmt7vkCdR8ic2VVX81h32uiI Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 7deb5e10b1a84db5bb34b6059fff861c Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:21:17.342488 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:21:17.343964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:17.343964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.343964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 7deb5e10b1a84db5bb34b6059fff861c Jul 25 12:21:17.343964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.343964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-VolumesNegativeTest-1940499370-project Jul 25 12:21:17.343964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:21:17.343964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:21:17.343964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 7c6602c69fad4e86a96e4c2843c4f5f7 Jul 25 12:21:17.343964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-VolumesNegativeTest-1940499370-project Jul 25 12:21:17.343964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: Jul 25 12:21:17.343964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Volume 94dfd83a-53bf-4846-95a3-e27260e487d8 could not be found. Jul 25 12:21:17.343964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': '94dfd83a-53bf-4846-95a3-e27260e487d8'} Jul 25 12:21:17.343964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94dfd83a-53bf-4846-95a3-e27260e487d8 could not be found. (HTTP 404) (Request-ID: req-9e7f9272-d028-48d4-909a-ecaad48641a7) Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.344727 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 12:21:17.345861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94dfd83a-53bf-4846-95a3-e27260e487d8 could not be found. Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 12:21:17.346964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94dfd83a-53bf-4846-95a3-e27260e487d8 could not be found. Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94dfd83a-53bf-4846-95a3-e27260e487d8 could not be found. Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fb9a5060-9159-4cea-a396-e4196a3629c6 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Returning 404 to user: Volume 94dfd83a-53bf-4846-95a3-e27260e487d8 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fb9a5060-9159-4cea-a396-e4196a3629c6 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/94dfd83a-53bf-4846-95a3-e27260e487d8" status: 404 len: 109 microversion: 2.1 time: 0.056885 Jul 25 12:21:17.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 417/839] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Jul 25 12:21:17 2022] DELETE /compute/v2.1/os-volumes/94dfd83a-53bf-4846-95a3-e27260e487d8 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:21:17.354822 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b7da7b88-d7f2-4454-bd61-e23593ba2c84 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Calling method '.version_select at 0x7f942c30d310>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:17.382165 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-b7da7b88-d7f2-4454-bd61-e23593ba2c84 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] HTTP exception thrown: Volume a90564a0-64a5-4284-a963-4fcf59ffb3e5 could not be found. Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b7da7b88-d7f2-4454-bd61-e23593ba2c84 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Request method failure captured: Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/os-volumes/a90564a0-64a5-4284-a963-4fcf59ffb3e5 HTTP/1.1 Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3oq8_8xw0TGRi1dqw6ygTSPc0CuUpFNFUFPYNOX44OzLIOXjcSOfZ3tczyABSrTpT6a-R8Y8KSLBbwVS196uNHI4eCJs81KVMfSxRElmcorBiZIznddbFBrxEGwOUhfzCXv85X8pDh5fzwkgpCuLO0fZmt7vkCdR8ic2VVX81h32uiI Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 7deb5e10b1a84db5bb34b6059fff861c Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:21:17.384166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:21:17.385677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7deb5e10b1a84db5bb34b6059fff861c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:17.385677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.385677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 7deb5e10b1a84db5bb34b6059fff861c Jul 25 12:21:17.385677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesNegativeTest-1940499370 Jul 25 12:21:17.385677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesNegativeTest-1940499370-project Jul 25 12:21:17.385677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:21:17.385677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:21:17.385677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 7c6602c69fad4e86a96e4c2843c4f5f7 Jul 25 12:21:17.385677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesNegativeTest-1940499370-project Jul 25 12:21:17.385677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: Jul 25 12:21:17.385677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Volume a90564a0-64a5-4284-a963-4fcf59ffb3e5 could not be found. Jul 25 12:21:17.385677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': 'a90564a0-64a5-4284-a963-4fcf59ffb3e5'} Jul 25 12:21:17.385677 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a90564a0-64a5-4284-a963-4fcf59ffb3e5 could not be found. (HTTP 404) (Request-ID: req-f238bcb6-5ce4-427f-9bc7-c39978b81fc2) Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.386643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:21:17.388085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a90564a0-64a5-4284-a963-4fcf59ffb3e5 could not be found. Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 12:21:17.389402 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a90564a0-64a5-4284-a963-4fcf59ffb3e5 could not be found. Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a90564a0-64a5-4284-a963-4fcf59ffb3e5 could not be found. Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b7da7b88-d7f2-4454-bd61-e23593ba2c84 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] Returning 404 to user: Volume a90564a0-64a5-4284-a963-4fcf59ffb3e5 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b7da7b88-d7f2-4454-bd61-e23593ba2c84 tempest-VolumesNegativeTest-1940499370 tempest-VolumesNegativeTest-1940499370-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a90564a0-64a5-4284-a963-4fcf59ffb3e5" status: 404 len: 109 microversion: 2.1 time: 0.035061 Jul 25 12:21:17.390862 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 423/840] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Jul 25 12:21:17 2022] GET /compute/v2.1/os-volumes/a90564a0-64a5-4284-a963-4fcf59ffb3e5 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:21:44.814860 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=51 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:44.815623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:44.822624 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ad923f7a-2f68-46ae-8178-aa2641f66ab2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:44.825255 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ad923f7a-2f68-46ae-8178-aa2641f66ab2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:44.834676 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ad923f7a-2f68-46ae-8178-aa2641f66ab2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:44.835415 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ad923f7a-2f68-46ae-8178-aa2641f66ab2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:44.836449 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ad923f7a-2f68-46ae-8178-aa2641f66ab2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:44.837262 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ad923f7a-2f68-46ae-8178-aa2641f66ab2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:44.876652 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ad923f7a-2f68-46ae-8178-aa2641f66ab2 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063702 Jul 25 12:21:44.878173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 418/841] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Jul 25 12:21:44 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:21:44.952124 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:44.954150 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=11 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:44.960429 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-90576d92-db1f-451b-987d-4f62445466cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:44.963008 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-90576d92-db1f-451b-987d-4f62445466cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:44.972492 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-90576d92-db1f-451b-987d-4f62445466cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:44.972943 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-90576d92-db1f-451b-987d-4f62445466cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:44.973878 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-90576d92-db1f-451b-987d-4f62445466cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:44.975522 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-90576d92-db1f-451b-987d-4f62445466cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:45.012190 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-90576d92-db1f-451b-987d-4f62445466cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:21:45.159252 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-90576d92-db1f-451b-987d-4f62445466cf tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "DELETE /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 204 len: 0 microversion: 2.20 time: 0.208667 Jul 25 12:21:45.160367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 424/842] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Jul 25 12:21:44 2022] DELETE /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:21:45.170162 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8028ee6b-bc55-4d98-905a-840b6bf12001 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:45.171002 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8028ee6b-bc55-4d98-905a-840b6bf12001 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:45.180796 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8028ee6b-bc55-4d98-905a-840b6bf12001 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:45.181511 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8028ee6b-bc55-4d98-905a-840b6bf12001 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:45.182490 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8028ee6b-bc55-4d98-905a-840b6bf12001 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:45.183080 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8028ee6b-bc55-4d98-905a-840b6bf12001 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:45.404745 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8028ee6b-bc55-4d98-905a-840b6bf12001 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:45.422697 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8028ee6b-bc55-4d98-905a-840b6bf12001 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:45.425486 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8028ee6b-bc55-4d98-905a-840b6bf12001 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:45.427754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8028ee6b-bc55-4d98-905a-840b6bf12001 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.261750 Jul 25 12:21:45.429086 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 419/843] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:21:45 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:21:46.460155 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-017f984b-330f-40fc-8848-9def3d939d2a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:46.461567 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-017f984b-330f-40fc-8848-9def3d939d2a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:46.493765 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-017f984b-330f-40fc-8848-9def3d939d2a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:46.495361 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-017f984b-330f-40fc-8848-9def3d939d2a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:46.497746 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-017f984b-330f-40fc-8848-9def3d939d2a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:46.502459 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-017f984b-330f-40fc-8848-9def3d939d2a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:46.776926 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-017f984b-330f-40fc-8848-9def3d939d2a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:46.795892 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-017f984b-330f-40fc-8848-9def3d939d2a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:46.804102 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-017f984b-330f-40fc-8848-9def3d939d2a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:46.808565 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-017f984b-330f-40fc-8848-9def3d939d2a tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1722 microversion: 2.20 time: 0.354177 Jul 25 12:21:46.824830 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 425/844] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:21:46 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:21:47.839177 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0c7c8226-b0c8-47df-a3b9-e89cee062a08 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:47.839919 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0c7c8226-b0c8-47df-a3b9-e89cee062a08 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:47.859279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c7c8226-b0c8-47df-a3b9-e89cee062a08 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:47.860694 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c7c8226-b0c8-47df-a3b9-e89cee062a08 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:47.864053 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c7c8226-b0c8-47df-a3b9-e89cee062a08 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:47.867008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c7c8226-b0c8-47df-a3b9-e89cee062a08 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:47.914829 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-2976cbdb-9f51-48b0-ae31-bd3ba93d1b83 req-f361d0d3-0dc0-4a71-b3d0-7a7439bc9076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "716acb40-a825-4b9b-a5f2-63d87980cf7a", "name": "network-vif-deleted", "tag": "d8ccc18c-ce12-4e5d-a124-191bdcd1d563"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:21:47.939113 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-2976cbdb-9f51-48b0-ae31-bd3ba93d1b83 req-f361d0d3-0dc0-4a71-b3d0-7a7439bc9076 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:47.939583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-2976cbdb-9f51-48b0-ae31-bd3ba93d1b83 req-f361d0d3-0dc0-4a71-b3d0-7a7439bc9076 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:47.994084 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-2976cbdb-9f51-48b0-ae31-bd3ba93d1b83 req-f361d0d3-0dc0-4a71-b3d0-7a7439bc9076 service nova] Creating event network-vif-deleted:d8ccc18c-ce12-4e5d-a124-191bdcd1d563 for instance 716acb40-a825-4b9b-a5f2-63d87980cf7a on hv-cinder-79760 Jul 25 12:21:48.010836 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-2976cbdb-9f51-48b0-ae31-bd3ba93d1b83 req-f361d0d3-0dc0-4a71-b3d0-7a7439bc9076 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101325 Jul 25 12:21:48.017386 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 426/845] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:21:48.120799 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0c7c8226-b0c8-47df-a3b9-e89cee062a08 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:48.134019 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0c7c8226-b0c8-47df-a3b9-e89cee062a08 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:48.137803 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0c7c8226-b0c8-47df-a3b9-e89cee062a08 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2d6f10a6fe841e5b1d12bce78f97d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef3a5bd8ffa43718ea02647f1f74fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:48.140400 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0c7c8226-b0c8-47df-a3b9-e89cee062a08 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 200 len: 1655 microversion: 2.20 time: 0.305322 Jul 25 12:21:48.155571 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 420/846] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:21:47 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 1655 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:21:49.170509 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c87524d9-d4fa-4ce2-a4c4-ecdea7ab12ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:49.171303 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c87524d9-d4fa-4ce2-a4c4-ecdea7ab12ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:49.183731 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c87524d9-d4fa-4ce2-a4c4-ecdea7ab12ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:49.184282 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c87524d9-d4fa-4ce2-a4c4-ecdea7ab12ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:49.186186 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c87524d9-d4fa-4ce2-a4c4-ecdea7ab12ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:49.189353 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c87524d9-d4fa-4ce2-a4c4-ecdea7ab12ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:49.251568 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-c87524d9-d4fa-4ce2-a4c4-ecdea7ab12ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] HTTP exception thrown: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c87524d9-d4fa-4ce2-a4c4-ecdea7ab12ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Request method failure captured: Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a HTTP/1.1 Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3ok16A8FqW4XdaonxWY03tsi-aNjmig20H5gvRHrXA0awGw5qgTMqIxS7dY5WTU_Vo4TPwsvXZ7BODvwk9Iip_dQmcFx11s7-9FBz_sDAKFYdz4QnlCuHt8_331UYo-gWlVOZ1imuI-mXKGnqIJ0-4YrNL7Hd5PKNiBJ3o9H0PTFB2I Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: aef3a5bd8ffa43718ea02647f1f74fc8 Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:21:49.261527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:21:49.263099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:49.263099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:49.263099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: aef3a5bd8ffa43718ea02647f1f74fc8 Jul 25 12:21:49.263099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:49.263099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeShelveTestJSON-1946517150-project Jul 25 12:21:49.263099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:21:49.263099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:21:49.263099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: d2d6f10a6fe841e5b1d12bce78f97d91 Jul 25 12:21:49.263099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1946517150-project Jul 25 12:21:49.263099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:21:49.263099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:49.263099 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '716acb40-a825-4b9b-a5f2-63d87980cf7a'} Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:49.263915 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:49.265819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:49.267282 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c87524d9-d4fa-4ce2-a4c4-ecdea7ab12ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Returning 404 to user: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:49.267282 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c87524d9-d4fa-4ce2-a4c4-ecdea7ab12ba tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 404 len: 111 microversion: 2.20 time: 0.100030 Jul 25 12:21:49.267282 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 427/847] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:21:49 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:21:49.275688 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-51693562-a416-420b-b025-e89fa2adc58c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '.version_select at 0x7f942c2949d0>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:49.309264 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-51693562-a416-420b-b025-e89fa2adc58c tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1282082106" status: 204 len: 0 microversion: 2.20 time: 0.038226 Jul 25 12:21:49.310431 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 421/848] 10.222.0.42 () {60 vars in 1262 bytes} [Mon Jul 25 12:21:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1282082106 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:21:51.828137 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f1effad1-bb0d-4787-8130-327db8012495 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:51.828703 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-f1effad1-bb0d-4787-8130-327db8012495 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:51.845162 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f1effad1-bb0d-4787-8130-327db8012495 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:51.845649 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f1effad1-bb0d-4787-8130-327db8012495 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:51.846523 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f1effad1-bb0d-4787-8130-327db8012495 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:51.847068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-f1effad1-bb0d-4787-8130-327db8012495 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:51.878642 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-f1effad1-bb0d-4787-8130-327db8012495 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] HTTP exception thrown: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f1effad1-bb0d-4787-8130-327db8012495 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Request method failure captured: Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: DELETE /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a HTTP/1.1 Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3ok16A8FqW4XdaonxWY03tsi-aNjmig20H5gvRHrXA0awGw5qgTMqIxS7dY5WTU_Vo4TPwsvXZ7BODvwk9Iip_dQmcFx11s7-9FBz_sDAKFYdz4QnlCuHt8_331UYo-gWlVOZ1imuI-mXKGnqIJ0-4YrNL7Hd5PKNiBJ3o9H0PTFB2I Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: aef3a5bd8ffa43718ea02647f1f74fc8 Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:21:51.880589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:21:51.882271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:51.882271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:51.882271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: aef3a5bd8ffa43718ea02647f1f74fc8 Jul 25 12:21:51.882271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:51.882271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeShelveTestJSON-1946517150-project Jul 25 12:21:51.882271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:21:51.882271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:21:51.882271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: d2d6f10a6fe841e5b1d12bce78f97d91 Jul 25 12:21:51.882271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1946517150-project Jul 25 12:21:51.882271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:21:51.882271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:51.882271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '716acb40-a825-4b9b-a5f2-63d87980cf7a'} Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:51.883286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:51.884784 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:51.896641 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-f1effad1-bb0d-4787-8130-327db8012495 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Returning 404 to user: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:51.900404 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-f1effad1-bb0d-4787-8130-327db8012495 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "DELETE /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 404 len: 111 microversion: 2.20 time: 0.074899 Jul 25 12:21:51.920797 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c9d5b903-6d98-486c-8059-cfcad5342953 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:51.923953 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c9d5b903-6d98-486c-8059-cfcad5342953 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 716acb40-a825-4b9b-a5f2-63d87980cf7a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:51.931525 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 428/849] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Jul 25 12:21:51 2022] DELETE /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:21:51.949941 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c9d5b903-6d98-486c-8059-cfcad5342953 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:51.956626 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c9d5b903-6d98-486c-8059-cfcad5342953 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:51.957475 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c9d5b903-6d98-486c-8059-cfcad5342953 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:51.957918 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c9d5b903-6d98-486c-8059-cfcad5342953 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:51.997115 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-c9d5b903-6d98-486c-8059-cfcad5342953 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] HTTP exception thrown: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c9d5b903-6d98-486c-8059-cfcad5342953 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Request method failure captured: Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a HTTP/1.1 Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3ok16A8FqW4XdaonxWY03tsi-aNjmig20H5gvRHrXA0awGw5qgTMqIxS7dY5WTU_Vo4TPwsvXZ7BODvwk9Iip_dQmcFx11s7-9FBz_sDAKFYdz4QnlCuHt8_331UYo-gWlVOZ1imuI-mXKGnqIJ0-4YrNL7Hd5PKNiBJ3o9H0PTFB2I Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: aef3a5bd8ffa43718ea02647f1f74fc8 Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:21:52.003699 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:21:52.005282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:52.005282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:52.005282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: aef3a5bd8ffa43718ea02647f1f74fc8 Jul 25 12:21:52.005282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:52.005282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeShelveTestJSON-1946517150-project Jul 25 12:21:52.005282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:21:52.005282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:21:52.005282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: d2d6f10a6fe841e5b1d12bce78f97d91 Jul 25 12:21:52.005282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1946517150-project Jul 25 12:21:52.005282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:21:52.005282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:52.005282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': '716acb40-a825-4b9b-a5f2-63d87980cf7a'} Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:52.006090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. Jul 25 12:21:52.007295 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:52.010942 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c9d5b903-6d98-486c-8059-cfcad5342953 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Returning 404 to user: Instance 716acb40-a825-4b9b-a5f2-63d87980cf7a could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:52.013062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c9d5b903-6d98-486c-8059-cfcad5342953 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a" status: 404 len: 111 microversion: 2.20 time: 0.103183 Jul 25 12:21:52.017073 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 422/850] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:21:51 2022] GET /compute/v2.1/servers/716acb40-a825-4b9b-a5f2-63d87980cf7a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:21:53.321649 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e0012794-f3cc-4681-a116-1e2502295fc8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:53.322378 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e0012794-f3cc-4681-a116-1e2502295fc8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:53.334712 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0012794-f3cc-4681-a116-1e2502295fc8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:53.337984 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0012794-f3cc-4681-a116-1e2502295fc8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:53.340896 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0012794-f3cc-4681-a116-1e2502295fc8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:53.343589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e0012794-f3cc-4681-a116-1e2502295fc8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:53.380492 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-e0012794-f3cc-4681-a116-1e2502295fc8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] HTTP exception thrown: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e0012794-f3cc-4681-a116-1e2502295fc8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Request method failure captured: Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: DELETE /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 HTTP/1.1 Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3ok16A8FqW4XdaonxWY03tsi-aNjmig20H5gvRHrXA0awGw5qgTMqIxS7dY5WTU_Vo4TPwsvXZ7BODvwk9Iip_dQmcFx11s7-9FBz_sDAKFYdz4QnlCuHt8_331UYo-gWlVOZ1imuI-mXKGnqIJ0-4YrNL7Hd5PKNiBJ3o9H0PTFB2I Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: aef3a5bd8ffa43718ea02647f1f74fc8 Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:21:53.382874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:21:53.384587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:53.384587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:53.384587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: aef3a5bd8ffa43718ea02647f1f74fc8 Jul 25 12:21:53.384587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:53.384587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-AttachVolumeShelveTestJSON-1946517150-project Jul 25 12:21:53.384587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:21:53.384587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:21:53.384587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: d2d6f10a6fe841e5b1d12bce78f97d91 Jul 25 12:21:53.384587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1946517150-project Jul 25 12:21:53.384587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:21:53.384587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:21:53.384587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '66654721-31e2-48d8-a0ea-c146d277ab47'} Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:53.385485 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:21:53.387011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:21:53.393455 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e0012794-f3cc-4681-a116-1e2502295fc8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Returning 404 to user: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:53.393455 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e0012794-f3cc-4681-a116-1e2502295fc8 tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "DELETE /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 404 len: 111 microversion: 2.20 time: 0.072615 Jul 25 12:21:53.393455 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 429/851] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Jul 25 12:21:53 2022] DELETE /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 12:21:53.397971 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-78acd0ac-49b5-41d1-b553-ca29e04ae85e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:53.398849 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-78acd0ac-49b5-41d1-b553-ca29e04ae85e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] [instance: 66654721-31e2-48d8-a0ea-c146d277ab47] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:53.407613 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78acd0ac-49b5-41d1-b553-ca29e04ae85e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:53.408062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78acd0ac-49b5-41d1-b553-ca29e04ae85e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:53.414075 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78acd0ac-49b5-41d1-b553-ca29e04ae85e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:53.415772 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-78acd0ac-49b5-41d1-b553-ca29e04ae85e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:53.453375 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-78acd0ac-49b5-41d1-b553-ca29e04ae85e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] HTTP exception thrown: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-78acd0ac-49b5-41d1-b553-ca29e04ae85e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Request method failure captured: Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 HTTP/1.1 Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3ok16A8FqW4XdaonxWY03tsi-aNjmig20H5gvRHrXA0awGw5qgTMqIxS7dY5WTU_Vo4TPwsvXZ7BODvwk9Iip_dQmcFx11s7-9FBz_sDAKFYdz4QnlCuHt8_331UYo-gWlVOZ1imuI-mXKGnqIJ0-4YrNL7Hd5PKNiBJ3o9H0PTFB2I Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: aef3a5bd8ffa43718ea02647f1f74fc8 Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:21:53.454505 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:21:53.456139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aef3a5bd8ffa43718ea02647f1f74fc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:21:53.456139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:53.456139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: aef3a5bd8ffa43718ea02647f1f74fc8 Jul 25 12:21:53.456139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1946517150 Jul 25 12:21:53.456139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-AttachVolumeShelveTestJSON-1946517150-project Jul 25 12:21:53.456139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:21:53.456139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:21:53.456139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: d2d6f10a6fe841e5b1d12bce78f97d91 Jul 25 12:21:53.456139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1946517150-project Jul 25 12:21:53.456139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:21:53.456139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:21:53.456139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': '66654721-31e2-48d8-a0ea-c146d277ab47'} Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:21:53.457344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. Jul 25 12:21:53.458569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:21:53.460351 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-78acd0ac-49b5-41d1-b553-ca29e04ae85e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] Returning 404 to user: Instance 66654721-31e2-48d8-a0ea-c146d277ab47 could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:21:53.460351 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-78acd0ac-49b5-41d1-b553-ca29e04ae85e tempest-AttachVolumeShelveTestJSON-1946517150 tempest-AttachVolumeShelveTestJSON-1946517150-project] 10.222.0.42 "GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47" status: 404 len: 111 microversion: 2.20 time: 0.062209 Jul 25 12:21:53.461834 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 423/852] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Jul 25 12:21:53 2022] GET /compute/v2.1/servers/66654721-31e2-48d8-a0ea-c146d277ab47 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:21:55.772224 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-288449036", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:21:55.840435 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] validate_networks() for None {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:21:56.080842 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-6a389555-b0ca-4ffb-b131-7fa97dcd0148 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Action: 'create', calling method: .version_select at 0x7f942c253f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1809500551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiOVFHmWFRQNldo7v+Trc2Vz16np3Dk0QJellKB7HMqHw4KOTzQ38dl5HxN3ev4L3RRoYGqx9taqKHYvlcEInwgAxNlNwUhJ8BADPJQIUqnfdaEYufb6cHZxbWOjc/4tQ=="}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:21:56.098437 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-6a389555-b0ca-4ffb-b131-7fa97dcd0148 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Getting quotas for project 141003bbc94b41569683aef4c15b46f1. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:21:56.103389 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-6a389555-b0ca-4ffb-b131-7fa97dcd0148 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Getting quotas for user 3494ce75df62497bb737254fd1665a3b and project 141003bbc94b41569683aef4c15b46f1. Resources: {'key_pairs'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:21:56.137904 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-6a389555-b0ca-4ffb-b131-7fa97dcd0148 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.454364 Jul 25 12:21:56.139930 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 430/853] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Jul 25 12:21:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:21:56.483874 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:21:56.484344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:21:56.484828 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:21:56.485236 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:21:56.492720 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:21:56.573844 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:56.574304 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:56.578829 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:56.589144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:56.625624 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Getting quotas for project f6b1d49d16c741d195afa089f5f1eb36. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:21:56.630941 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Getting quotas for user 922702e951594912bea9546b33ed0335 and project f6b1d49d16c741d195afa089f5f1eb36. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:21:56.676673 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:21:56.691443 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:21:56.759868 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-df572d6e-404d-4c9e-9fbf-d2e1247ac8dd tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.992690 Jul 25 12:21:56.761702 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 424/854] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:21:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 12:21:56.798360 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8895abda-4e44-4708-a65b-bf24e3a015a3 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:56.799320 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8895abda-4e44-4708-a65b-bf24e3a015a3 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:56.917328 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8895abda-4e44-4708-a65b-bf24e3a015a3 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:56.928983 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8895abda-4e44-4708-a65b-bf24e3a015a3 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1214 microversion: 2.1 time: 0.145060 Jul 25 12:21:56.930507 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 431/855] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:21:56 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:21:57.960283 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8dea7cce-f9d9-4a6f-a049-da19245098ae tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:57.968678 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8dea7cce-f9d9-4a6f-a049-da19245098ae tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:57.980833 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8dea7cce-f9d9-4a6f-a049-da19245098ae tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:57.981560 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8dea7cce-f9d9-4a6f-a049-da19245098ae tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:57.982613 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8dea7cce-f9d9-4a6f-a049-da19245098ae tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:57.983238 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8dea7cce-f9d9-4a6f-a049-da19245098ae tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:58.403635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8dea7cce-f9d9-4a6f-a049-da19245098ae tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:58.412486 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8dea7cce-f9d9-4a6f-a049-da19245098ae tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1266 microversion: 2.1 time: 0.465194 Jul 25 12:21:58.424768 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 425/856] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:21:57 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1266 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:21:59.436742 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9c75eab1-44eb-4979-83ba-719cc05f78c6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:21:59.438086 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9c75eab1-44eb-4979-83ba-719cc05f78c6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:21:59.451578 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c75eab1-44eb-4979-83ba-719cc05f78c6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:59.451578 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c75eab1-44eb-4979-83ba-719cc05f78c6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:59.451578 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c75eab1-44eb-4979-83ba-719cc05f78c6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:21:59.451578 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9c75eab1-44eb-4979-83ba-719cc05f78c6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:21:59.564584 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-9c75eab1-44eb-4979-83ba-719cc05f78c6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:21:59.574731 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9c75eab1-44eb-4979-83ba-719cc05f78c6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1272 microversion: 2.1 time: 0.142034 Jul 25 12:21:59.586438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 432/857] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:21:59 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:00.597828 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-44f4cd85-5c65-4c3f-a0c6-b812405777b6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:00.598319 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-44f4cd85-5c65-4c3f-a0c6-b812405777b6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:00.611054 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44f4cd85-5c65-4c3f-a0c6-b812405777b6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:00.611603 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44f4cd85-5c65-4c3f-a0c6-b812405777b6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:00.612440 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44f4cd85-5c65-4c3f-a0c6-b812405777b6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:00.612938 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-44f4cd85-5c65-4c3f-a0c6-b812405777b6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:00.701952 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-e4ef74de-4f33-4f64-acba-ab65128f0107 req-4bbfa1b9-c20c-45a1-90d5-c6414430e61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da5c2d21-6ce0-4c45-9012-c4cf97078a80", "tag": "ae88cc57-20e8-4698-9159-c184775d462b"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:22:00.718513 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-e4ef74de-4f33-4f64-acba-ab65128f0107 req-4bbfa1b9-c20c-45a1-90d5-c6414430e61c service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:00.719034 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-e4ef74de-4f33-4f64-acba-ab65128f0107 req-4bbfa1b9-c20c-45a1-90d5-c6414430e61c service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:00.748720 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-e4ef74de-4f33-4f64-acba-ab65128f0107 req-4bbfa1b9-c20c-45a1-90d5-c6414430e61c service nova] Creating event network-changed:ae88cc57-20e8-4698-9159-c184775d462b for instance da5c2d21-6ce0-4c45-9012-c4cf97078a80 on hv-cinder-79760 Jul 25 12:22:00.765363 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-e4ef74de-4f33-4f64-acba-ab65128f0107 req-4bbfa1b9-c20c-45a1-90d5-c6414430e61c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066935 Jul 25 12:22:00.766387 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 433/858] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:22:00.952169 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-44f4cd85-5c65-4c3f-a0c6-b812405777b6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:00.962755 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-44f4cd85-5c65-4c3f-a0c6-b812405777b6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1314 microversion: 2.1 time: 0.370669 Jul 25 12:22:00.963867 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 426/859] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:00 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:01.990449 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4d3d5334-d93a-4cf3-9d9e-d3234b472bf5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:01.991145 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4d3d5334-d93a-4cf3-9d9e-d3234b472bf5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:01.997737 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d3d5334-d93a-4cf3-9d9e-d3234b472bf5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:01.998439 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d3d5334-d93a-4cf3-9d9e-d3234b472bf5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:01.999218 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d3d5334-d93a-4cf3-9d9e-d3234b472bf5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:01.999814 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4d3d5334-d93a-4cf3-9d9e-d3234b472bf5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:02.247132 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4d3d5334-d93a-4cf3-9d9e-d3234b472bf5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:02.257899 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4d3d5334-d93a-4cf3-9d9e-d3234b472bf5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1314 microversion: 2.1 time: 0.273576 Jul 25 12:22:02.274683 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 434/860] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:01 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:03.279963 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-76e56c37-8f58-4bb8-971f-df8bb43ec82b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:03.280570 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-76e56c37-8f58-4bb8-971f-df8bb43ec82b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:03.287098 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76e56c37-8f58-4bb8-971f-df8bb43ec82b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:03.287538 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76e56c37-8f58-4bb8-971f-df8bb43ec82b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:03.288321 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76e56c37-8f58-4bb8-971f-df8bb43ec82b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:03.288748 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76e56c37-8f58-4bb8-971f-df8bb43ec82b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:03.428159 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-76e56c37-8f58-4bb8-971f-df8bb43ec82b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:03.435740 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-76e56c37-8f58-4bb8-971f-df8bb43ec82b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1314 microversion: 2.1 time: 0.159700 Jul 25 12:22:03.436304 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 427/861] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:03 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:04.456725 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4b41d1b5-7120-42e2-8333-53f7d21dc4ec tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:04.457861 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4b41d1b5-7120-42e2-8333-53f7d21dc4ec tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:04.464412 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4b41d1b5-7120-42e2-8333-53f7d21dc4ec tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:04.464861 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4b41d1b5-7120-42e2-8333-53f7d21dc4ec tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:04.465609 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4b41d1b5-7120-42e2-8333-53f7d21dc4ec tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:04.466042 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4b41d1b5-7120-42e2-8333-53f7d21dc4ec tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:04.593122 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4b41d1b5-7120-42e2-8333-53f7d21dc4ec tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:04.601180 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4b41d1b5-7120-42e2-8333-53f7d21dc4ec tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1314 microversion: 2.1 time: 0.148359 Jul 25 12:22:04.601757 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 435/862] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:04 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:22:05.622368 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-31ec0b1e-07ea-4b1e-a204-02e2b0e9f4c5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:05.622975 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-31ec0b1e-07ea-4b1e-a204-02e2b0e9f4c5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:05.630047 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-31ec0b1e-07ea-4b1e-a204-02e2b0e9f4c5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:05.630495 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-31ec0b1e-07ea-4b1e-a204-02e2b0e9f4c5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:05.631256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-31ec0b1e-07ea-4b1e-a204-02e2b0e9f4c5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:05.631721 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-31ec0b1e-07ea-4b1e-a204-02e2b0e9f4c5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:05.766161 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-31ec0b1e-07ea-4b1e-a204-02e2b0e9f4c5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:05.774256 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-31ec0b1e-07ea-4b1e-a204-02e2b0e9f4c5 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1314 microversion: 2.1 time: 0.155726 Jul 25 12:22:05.774828 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 428/863] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:05 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:06.569225 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-d847c25f-a72e-4e57-bd05-fa5e0f6e6d28 req-93c1e2ac-3e12-44a7-851d-0d02ff8c040f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5c2d21-6ce0-4c45-9012-c4cf97078a80", "name": "network-vif-plugged", "status": "completed", "tag": "ae88cc57-20e8-4698-9159-c184775d462b"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:22:06.578765 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-d847c25f-a72e-4e57-bd05-fa5e0f6e6d28 req-93c1e2ac-3e12-44a7-851d-0d02ff8c040f service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:06.579160 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-d847c25f-a72e-4e57-bd05-fa5e0f6e6d28 req-93c1e2ac-3e12-44a7-851d-0d02ff8c040f service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:06.590890 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-d847c25f-a72e-4e57-bd05-fa5e0f6e6d28 req-93c1e2ac-3e12-44a7-851d-0d02ff8c040f service nova] Creating event network-vif-plugged:ae88cc57-20e8-4698-9159-c184775d462b for instance da5c2d21-6ce0-4c45-9012-c4cf97078a80 on hv-cinder-79760 Jul 25 12:22:06.595933 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-d847c25f-a72e-4e57-bd05-fa5e0f6e6d28 req-93c1e2ac-3e12-44a7-851d-0d02ff8c040f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030422 Jul 25 12:22:06.596512 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 436/864] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:22:06.794121 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0c24c959-9767-49a0-951f-13fb3b82bdb6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:06.794766 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0c24c959-9767-49a0-951f-13fb3b82bdb6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:06.796633 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:06.797799 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:06.803853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c24c959-9767-49a0-951f-13fb3b82bdb6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:06.804303 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c24c959-9767-49a0-951f-13fb3b82bdb6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:06.805069 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c24c959-9767-49a0-951f-13fb3b82bdb6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:06.805507 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c24c959-9767-49a0-951f-13fb3b82bdb6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:06.936893 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0c24c959-9767-49a0-951f-13fb3b82bdb6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:06.944769 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0c24c959-9767-49a0-951f-13fb3b82bdb6 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1314 microversion: 2.1 time: 0.154486 Jul 25 12:22:06.945327 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 429/865] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:06 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:07.963051 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:07.967737 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cbea75ea-9533-475e-a1c0-9e4db0f42f7e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:07.968438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cbea75ea-9533-475e-a1c0-9e4db0f42f7e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:07.975536 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cbea75ea-9533-475e-a1c0-9e4db0f42f7e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:07.976072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cbea75ea-9533-475e-a1c0-9e4db0f42f7e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:07.976779 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cbea75ea-9533-475e-a1c0-9e4db0f42f7e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:07.977219 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cbea75ea-9533-475e-a1c0-9e4db0f42f7e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:08.113634 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cbea75ea-9533-475e-a1c0-9e4db0f42f7e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:08.121404 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cbea75ea-9533-475e-a1c0-9e4db0f42f7e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1314 microversion: 2.1 time: 0.159242 Jul 25 12:22:08.121974 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 437/866] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:07 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:09.142207 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-52f3460e-712f-4937-8bbf-72ee80854d1e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:09.142815 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-52f3460e-712f-4937-8bbf-72ee80854d1e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:09.149106 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52f3460e-712f-4937-8bbf-72ee80854d1e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:09.149554 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52f3460e-712f-4937-8bbf-72ee80854d1e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:09.150296 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52f3460e-712f-4937-8bbf-72ee80854d1e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:09.150723 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-52f3460e-712f-4937-8bbf-72ee80854d1e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:09.279412 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-52f3460e-712f-4937-8bbf-72ee80854d1e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:09.287359 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-52f3460e-712f-4937-8bbf-72ee80854d1e tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1314 microversion: 2.1 time: 0.149120 Jul 25 12:22:09.287945 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 430/867] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:09 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:10.308663 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cae33641-6b97-4c55-a5f5-991be5ada457 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:10.309277 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cae33641-6b97-4c55-a5f5-991be5ada457 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:10.315858 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cae33641-6b97-4c55-a5f5-991be5ada457 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:10.316313 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cae33641-6b97-4c55-a5f5-991be5ada457 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:10.317072 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cae33641-6b97-4c55-a5f5-991be5ada457 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:10.317507 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cae33641-6b97-4c55-a5f5-991be5ada457 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:10.446942 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cae33641-6b97-4c55-a5f5-991be5ada457 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:10.454756 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cae33641-6b97-4c55-a5f5-991be5ada457 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1464 microversion: 2.1 time: 0.149675 Jul 25 12:22:10.455710 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 438/868] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:10 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:10.502506 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-fa5ab3f0-7d46-4257-b001-79cf6dcebd36 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:10.503194 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fa5ab3f0-7d46-4257-b001-79cf6dcebd36 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:10.510321 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fa5ab3f0-7d46-4257-b001-79cf6dcebd36 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:10.510768 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fa5ab3f0-7d46-4257-b001-79cf6dcebd36 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:10.511569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fa5ab3f0-7d46-4257-b001-79cf6dcebd36 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:10.512005 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-fa5ab3f0-7d46-4257-b001-79cf6dcebd36 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:10.540951 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-fa5ab3f0-7d46-4257-b001-79cf6dcebd36 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:22:10.627716 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-fa5ab3f0-7d46-4257-b001-79cf6dcebd36 tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "DELETE /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 204 len: 0 microversion: 2.1 time: 0.128783 Jul 25 12:22:10.628286 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 431/869] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:22:10 2022] DELETE /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:22:10.636505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aa6aef3e-a476-40f9-b356-a8a99bccb65b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:10.637249 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-aa6aef3e-a476-40f9-b356-a8a99bccb65b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:10.644585 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa6aef3e-a476-40f9-b356-a8a99bccb65b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:10.645171 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa6aef3e-a476-40f9-b356-a8a99bccb65b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:10.646100 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa6aef3e-a476-40f9-b356-a8a99bccb65b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:10.646640 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa6aef3e-a476-40f9-b356-a8a99bccb65b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:10.776407 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-aa6aef3e-a476-40f9-b356-a8a99bccb65b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:10.784202 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-aa6aef3e-a476-40f9-b356-a8a99bccb65b tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1470 microversion: 2.1 time: 0.151581 Jul 25 12:22:10.784804 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 439/870] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:10 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:11.806907 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-85ae515d-6927-4bc9-b612-e1c13bd9b13a tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:11.807641 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-85ae515d-6927-4bc9-b612-e1c13bd9b13a tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:11.814052 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-85ae515d-6927-4bc9-b612-e1c13bd9b13a tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:11.814525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-85ae515d-6927-4bc9-b612-e1c13bd9b13a tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:11.815276 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-85ae515d-6927-4bc9-b612-e1c13bd9b13a tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:11.815763 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-85ae515d-6927-4bc9-b612-e1c13bd9b13a tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:11.948881 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-85ae515d-6927-4bc9-b612-e1c13bd9b13a tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:11.956386 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-85ae515d-6927-4bc9-b612-e1c13bd9b13a tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1470 microversion: 2.1 time: 0.153850 Jul 25 12:22:11.956938 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 432/871] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:11 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:12.640896 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-11603379-9c0f-44e5-91bd-529b13379929 req-f4706d3f-90a7-41f8-93bb-8279a57bbc27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5c2d21-6ce0-4c45-9012-c4cf97078a80", "name": "network-vif-deleted", "tag": "ae88cc57-20e8-4698-9159-c184775d462b"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:22:12.651692 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-11603379-9c0f-44e5-91bd-529b13379929 req-f4706d3f-90a7-41f8-93bb-8279a57bbc27 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:12.652134 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-11603379-9c0f-44e5-91bd-529b13379929 req-f4706d3f-90a7-41f8-93bb-8279a57bbc27 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:12.665166 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-11603379-9c0f-44e5-91bd-529b13379929 req-f4706d3f-90a7-41f8-93bb-8279a57bbc27 service nova] Creating event network-vif-deleted:ae88cc57-20e8-4698-9159-c184775d462b for instance da5c2d21-6ce0-4c45-9012-c4cf97078a80 on hv-cinder-79760 Jul 25 12:22:12.671163 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-11603379-9c0f-44e5-91bd-529b13379929 req-f4706d3f-90a7-41f8-93bb-8279a57bbc27 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033863 Jul 25 12:22:12.671825 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 440/872] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:22:12.977121 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bceccca1-3659-4509-bab0-65a3c3a8861d tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:12.977721 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bceccca1-3659-4509-bab0-65a3c3a8861d tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:12.984755 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bceccca1-3659-4509-bab0-65a3c3a8861d tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:12.985196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bceccca1-3659-4509-bab0-65a3c3a8861d tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:12.985972 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bceccca1-3659-4509-bab0-65a3c3a8861d tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:12.986402 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bceccca1-3659-4509-bab0-65a3c3a8861d tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:13.028820 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bceccca1-3659-4509-bab0-65a3c3a8861d tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:13.030194 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bceccca1-3659-4509-bab0-65a3c3a8861d tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:13.031334 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-bceccca1-3659-4509-bab0-65a3c3a8861d tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lazy-loading 'fault' on Instance uuid da5c2d21-6ce0-4c45-9012-c4cf97078a80 {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:22:13.077622 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bceccca1-3659-4509-bab0-65a3c3a8861d tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922702e951594912bea9546b33ed0335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1d49d16c741d195afa089f5f1eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:13.085756 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bceccca1-3659-4509-bab0-65a3c3a8861d tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 200 len: 1304 microversion: 2.1 time: 0.112602 Jul 25 12:22:13.086312 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 433/873] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:12 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:14.108613 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4e682168-90bc-4b25-aadb-b01e377381ba tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:14.109310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4e682168-90bc-4b25-aadb-b01e377381ba tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] [instance: da5c2d21-6ce0-4c45-9012-c4cf97078a80] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:14.115442 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e682168-90bc-4b25-aadb-b01e377381ba tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:14.115917 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e682168-90bc-4b25-aadb-b01e377381ba tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:14.116673 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e682168-90bc-4b25-aadb-b01e377381ba tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:14.117089 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4e682168-90bc-4b25-aadb-b01e377381ba tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:14.129982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-4e682168-90bc-4b25-aadb-b01e377381ba tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] HTTP exception thrown: Instance da5c2d21-6ce0-4c45-9012-c4cf97078a80 could not be found. Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4e682168-90bc-4b25-aadb-b01e377381ba tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Request method failure captured: Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 HTTP/1.1 Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3orhy0uMxhRoR7SotwwcDUiWEU5ztytIpGkfvoyXHueSi9eC0rGfglX0PYJjxBTZHfo_71z-HywifRaGUcKTbZC-lpjJmv1ju8MNz4zAowXO4jsyTHee51D7hk-T-OvCO1AH9R1x981Dt8xwe2Xpb1sIiXYkJCt3pzHl5sgKOPc9qbo Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: f6b1d49d16c741d195afa089f5f1eb36 Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesNegativeTest-128518607 Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:22:14.131583 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:22:14.133236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f6b1d49d16c741d195afa089f5f1eb36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f6b1d49d16c741d195afa089f5f1eb36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f6b1d49d16c741d195afa089f5f1eb36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f6b1d49d16c741d195afa089f5f1eb36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:22:14.133236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesNegativeTest-128518607 Jul 25 12:22:14.133236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: f6b1d49d16c741d195afa089f5f1eb36 Jul 25 12:22:14.133236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesNegativeTest-128518607 Jul 25 12:22:14.133236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesNegativeTest-128518607-project Jul 25 12:22:14.133236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:22:14.133236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:22:14.133236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 922702e951594912bea9546b33ed0335 Jul 25 12:22:14.133236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesNegativeTest-128518607-project Jul 25 12:22:14.133236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:22:14.133236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance da5c2d21-6ce0-4c45-9012-c4cf97078a80 could not be found. Jul 25 12:22:14.133236 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': 'da5c2d21-6ce0-4c45-9012-c4cf97078a80'} Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da5c2d21-6ce0-4c45-9012-c4cf97078a80 could not be found. Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:22:14.134388 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da5c2d21-6ce0-4c45-9012-c4cf97078a80 could not be found. Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da5c2d21-6ce0-4c45-9012-c4cf97078a80 could not be found. Jul 25 12:22:14.136259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:22:14.137639 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4e682168-90bc-4b25-aadb-b01e377381ba tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] Returning 404 to user: Instance da5c2d21-6ce0-4c45-9012-c4cf97078a80 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:22:14.137639 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4e682168-90bc-4b25-aadb-b01e377381ba tempest-VolumesNegativeTest-128518607 tempest-VolumesNegativeTest-128518607-project] 10.222.0.42 "GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80" status: 404 len: 111 microversion: 2.1 time: 0.029020 Jul 25 12:22:14.137639 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 441/874] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:14 2022] GET /compute/v2.1/servers/da5c2d21-6ce0-4c45-9012-c4cf97078a80 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:22:25.327959 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1960929701", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1809500551", "security_groups": [{"name": "tempest-secgroup-smoke-1054820741"}], "block_device_mapping_v2": [{"uuid": "4a7d406a-19e7-4e78-8d16-fc63623a0aae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11d8ce76-c85a-44ea-b9a3-bfb714066192"}]}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:22:25.338319 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:25.339149 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:25.442393 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] validate_networks() for [('11d8ce76-c85a-44ea-b9a3-bfb714066192', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:22:25.923918 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:22:25.924346 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:22:25.924823 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:22:25.925236 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:22:25.925647 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:22:25.934450 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:25.934899 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:25.935749 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:25.936215 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:25.953524 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Getting quotas for project 141003bbc94b41569683aef4c15b46f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:22:25.957470 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Getting quotas for user 3494ce75df62497bb737254fd1665a3b and project 141003bbc94b41569683aef4c15b46f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:22:26.013767 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:22:26.015843 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a7d406a-19e7-4e78-8d16-fc63623a0aae',volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:22:26.147426 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-19dd0127-b0b6-4892-9af2-6d5110d76164 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.822432 Jul 25 12:22:26.148417 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 434/875] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:22:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:22:26.159428 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ee0a3b00-f3fa-48f8-ab8b-ed3fc1e025d9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:26.160377 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ee0a3b00-f3fa-48f8-ab8b-ed3fc1e025d9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:26.163746 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:26.164518 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:26.222963 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ee0a3b00-f3fa-48f8-ab8b-ed3fc1e025d9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:26.229967 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ee0a3b00-f3fa-48f8-ab8b-ed3fc1e025d9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1095 microversion: 2.1 time: 0.074445 Jul 25 12:22:26.230714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 442/876] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:26 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:22:27.250553 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d962ac45-415d-4c0f-808b-52e2da0b73be tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:27.251289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d962ac45-415d-4c0f-808b-52e2da0b73be tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:27.260758 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d962ac45-415d-4c0f-808b-52e2da0b73be tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:27.261241 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d962ac45-415d-4c0f-808b-52e2da0b73be tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:27.262008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d962ac45-415d-4c0f-808b-52e2da0b73be tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:27.262442 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d962ac45-415d-4c0f-808b-52e2da0b73be tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:27.322326 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d962ac45-415d-4c0f-808b-52e2da0b73be tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:27.329588 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d962ac45-415d-4c0f-808b-52e2da0b73be tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1193 microversion: 2.1 time: 0.082927 Jul 25 12:22:27.330137 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 435/877] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:27 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:28.350174 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3628ff43-f53f-4161-acf3-0dfc03702ba0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:28.350880 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3628ff43-f53f-4161-acf3-0dfc03702ba0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:28.357953 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3628ff43-f53f-4161-acf3-0dfc03702ba0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:28.358399 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3628ff43-f53f-4161-acf3-0dfc03702ba0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:28.359154 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3628ff43-f53f-4161-acf3-0dfc03702ba0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:28.359603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3628ff43-f53f-4161-acf3-0dfc03702ba0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:28.433392 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3628ff43-f53f-4161-acf3-0dfc03702ba0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:28.440820 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3628ff43-f53f-4161-acf3-0dfc03702ba0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1193 microversion: 2.1 time: 0.094393 Jul 25 12:22:28.441376 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 443/878] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:28 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:29.462398 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cfd99692-a55e-4415-8132-9ea239b59588 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:29.463111 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cfd99692-a55e-4415-8132-9ea239b59588 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:29.469746 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cfd99692-a55e-4415-8132-9ea239b59588 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:29.470267 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cfd99692-a55e-4415-8132-9ea239b59588 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:29.471115 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cfd99692-a55e-4415-8132-9ea239b59588 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:29.471565 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cfd99692-a55e-4415-8132-9ea239b59588 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:29.536071 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cfd99692-a55e-4415-8132-9ea239b59588 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:29.543632 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cfd99692-a55e-4415-8132-9ea239b59588 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1193 microversion: 2.1 time: 0.085662 Jul 25 12:22:29.544202 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 436/879] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:29 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:30.564560 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c08c848a-7d62-439e-9f18-6f2b641db8b6 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:30.565177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c08c848a-7d62-439e-9f18-6f2b641db8b6 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:30.575840 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c08c848a-7d62-439e-9f18-6f2b641db8b6 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:30.576292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c08c848a-7d62-439e-9f18-6f2b641db8b6 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:30.577090 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c08c848a-7d62-439e-9f18-6f2b641db8b6 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:30.577525 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c08c848a-7d62-439e-9f18-6f2b641db8b6 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:30.963167 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c08c848a-7d62-439e-9f18-6f2b641db8b6 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:30.973403 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c08c848a-7d62-439e-9f18-6f2b641db8b6 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1211 microversion: 2.1 time: 0.412534 Jul 25 12:22:30.973987 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 444/880] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:30 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1211 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:31.507836 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-60240d15-3842-4a82-ae87-19644b8dbaa9 req-22ed7009-acbc-43ad-a695-2edd7c5fa5eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a", "tag": "1ad2d7c4-0c36-4f08-b535-a2075df94aa9"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:22:31.518429 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-60240d15-3842-4a82-ae87-19644b8dbaa9 req-22ed7009-acbc-43ad-a695-2edd7c5fa5eb service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:31.518877 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-60240d15-3842-4a82-ae87-19644b8dbaa9 req-22ed7009-acbc-43ad-a695-2edd7c5fa5eb service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:31.536528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-60240d15-3842-4a82-ae87-19644b8dbaa9 req-22ed7009-acbc-43ad-a695-2edd7c5fa5eb service nova] Creating event network-changed:1ad2d7c4-0c36-4f08-b535-a2075df94aa9 for instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a on hv-cinder-79760 Jul 25 12:22:31.542150 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-60240d15-3842-4a82-ae87-19644b8dbaa9 req-22ed7009-acbc-43ad-a695-2edd7c5fa5eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038773 Jul 25 12:22:31.543350 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 437/881] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:22:31.996121 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-43c7eae7-2cd8-44ec-9e23-7008d244ff15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:31.996664 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-43c7eae7-2cd8-44ec-9e23-7008d244ff15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:32.003026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43c7eae7-2cd8-44ec-9e23-7008d244ff15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:32.003473 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43c7eae7-2cd8-44ec-9e23-7008d244ff15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:32.004276 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43c7eae7-2cd8-44ec-9e23-7008d244ff15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:32.004704 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-43c7eae7-2cd8-44ec-9e23-7008d244ff15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:32.135710 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-43c7eae7-2cd8-44ec-9e23-7008d244ff15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:32.143104 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-43c7eae7-2cd8-44ec-9e23-7008d244ff15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1267 microversion: 2.1 time: 0.150826 Jul 25 12:22:32.143691 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 445/882] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:31 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:33.166448 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5a20d009-4712-4f78-82a2-c8c8904f1c7f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:33.167309 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5a20d009-4712-4f78-82a2-c8c8904f1c7f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:33.173790 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a20d009-4712-4f78-82a2-c8c8904f1c7f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:33.174359 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a20d009-4712-4f78-82a2-c8c8904f1c7f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:33.175187 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a20d009-4712-4f78-82a2-c8c8904f1c7f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:33.175920 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5a20d009-4712-4f78-82a2-c8c8904f1c7f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:33.331237 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5a20d009-4712-4f78-82a2-c8c8904f1c7f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:33.339183 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5a20d009-4712-4f78-82a2-c8c8904f1c7f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1267 microversion: 2.1 time: 0.178034 Jul 25 12:22:33.339788 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 438/883] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:33 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:34.361856 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-1c6aff26-642a-46fd-878a-231e95caa011 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:34.362712 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-1c6aff26-642a-46fd-878a-231e95caa011 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:34.369926 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c6aff26-642a-46fd-878a-231e95caa011 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:34.370362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c6aff26-642a-46fd-878a-231e95caa011 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:34.371124 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c6aff26-642a-46fd-878a-231e95caa011 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:34.371568 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-1c6aff26-642a-46fd-878a-231e95caa011 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:34.520105 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-1c6aff26-642a-46fd-878a-231e95caa011 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:34.528274 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-1c6aff26-642a-46fd-878a-231e95caa011 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1267 microversion: 2.1 time: 0.170985 Jul 25 12:22:34.528854 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 446/884] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:34 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:22:35.549619 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-45026333-afcf-4bb9-b9bd-f95c7141b61b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:35.550233 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-45026333-afcf-4bb9-b9bd-f95c7141b61b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:35.557279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45026333-afcf-4bb9-b9bd-f95c7141b61b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:35.557730 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45026333-afcf-4bb9-b9bd-f95c7141b61b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:35.558492 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45026333-afcf-4bb9-b9bd-f95c7141b61b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:35.558928 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-45026333-afcf-4bb9-b9bd-f95c7141b61b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:35.695216 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-45026333-afcf-4bb9-b9bd-f95c7141b61b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:35.703054 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-45026333-afcf-4bb9-b9bd-f95c7141b61b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1267 microversion: 2.1 time: 0.157335 Jul 25 12:22:35.703625 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 439/885] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:35 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:36.723102 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-78fb597d-9fc7-4843-8f24-d83a1e4c7028 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:36.723710 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-78fb597d-9fc7-4843-8f24-d83a1e4c7028 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:36.725753 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:36.731615 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78fb597d-9fc7-4843-8f24-d83a1e4c7028 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:36.732076 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78fb597d-9fc7-4843-8f24-d83a1e4c7028 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:36.732841 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78fb597d-9fc7-4843-8f24-d83a1e4c7028 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:36.733284 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78fb597d-9fc7-4843-8f24-d83a1e4c7028 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:36.864073 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-78fb597d-9fc7-4843-8f24-d83a1e4c7028 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:36.871372 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-78fb597d-9fc7-4843-8f24-d83a1e4c7028 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1267 microversion: 2.1 time: 0.152299 Jul 25 12:22:36.871970 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 447/886] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:36 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:37.892542 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-95eacacc-00b0-4596-8f27-7cc39efbce71 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:37.893239 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-95eacacc-00b0-4596-8f27-7cc39efbce71 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:37.895389 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:37.896074 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:37.902078 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95eacacc-00b0-4596-8f27-7cc39efbce71 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:37.902525 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95eacacc-00b0-4596-8f27-7cc39efbce71 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:37.903299 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95eacacc-00b0-4596-8f27-7cc39efbce71 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:37.903760 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-95eacacc-00b0-4596-8f27-7cc39efbce71 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:38.038812 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-95eacacc-00b0-4596-8f27-7cc39efbce71 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:38.046243 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-95eacacc-00b0-4596-8f27-7cc39efbce71 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1267 microversion: 2.1 time: 0.157617 Jul 25 12:22:38.046801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 440/887] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:37 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:39.067144 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2accefff-4253-499f-b84a-5be81e564e86 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:39.067789 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2accefff-4253-499f-b84a-5be81e564e86 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:39.077046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2accefff-4253-499f-b84a-5be81e564e86 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:39.077521 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2accefff-4253-499f-b84a-5be81e564e86 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:39.078289 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2accefff-4253-499f-b84a-5be81e564e86 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:39.078723 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2accefff-4253-499f-b84a-5be81e564e86 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:39.214027 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2accefff-4253-499f-b84a-5be81e564e86 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:39.221594 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2accefff-4253-499f-b84a-5be81e564e86 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1267 microversion: 2.1 time: 0.158232 Jul 25 12:22:39.226028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 448/888] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:39 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:40.243535 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-97d49d70-3377-4e2b-8b29-c0d242cd50c3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:40.252949 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-97d49d70-3377-4e2b-8b29-c0d242cd50c3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:40.259513 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97d49d70-3377-4e2b-8b29-c0d242cd50c3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:40.259996 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97d49d70-3377-4e2b-8b29-c0d242cd50c3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:40.260770 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97d49d70-3377-4e2b-8b29-c0d242cd50c3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:40.261201 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97d49d70-3377-4e2b-8b29-c0d242cd50c3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:40.398251 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-97d49d70-3377-4e2b-8b29-c0d242cd50c3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:40.405979 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-97d49d70-3377-4e2b-8b29-c0d242cd50c3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1267 microversion: 2.1 time: 0.166271 Jul 25 12:22:40.406526 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 441/889] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:40 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:41.426001 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-cbdb3920-06d2-45a0-b6cc-a8441a2eaea9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:41.426520 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-cbdb3920-06d2-45a0-b6cc-a8441a2eaea9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:41.433580 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cbdb3920-06d2-45a0-b6cc-a8441a2eaea9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:41.434029 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cbdb3920-06d2-45a0-b6cc-a8441a2eaea9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:41.434792 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cbdb3920-06d2-45a0-b6cc-a8441a2eaea9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:41.435227 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-cbdb3920-06d2-45a0-b6cc-a8441a2eaea9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:41.570954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-cbdb3920-06d2-45a0-b6cc-a8441a2eaea9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:41.578653 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-cbdb3920-06d2-45a0-b6cc-a8441a2eaea9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1267 microversion: 2.1 time: 0.156478 Jul 25 12:22:41.579216 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 449/890] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:41 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:42.599564 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-00f22336-ea94-4dfa-9719-5b902c7e80bc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:42.600453 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-00f22336-ea94-4dfa-9719-5b902c7e80bc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:42.607939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00f22336-ea94-4dfa-9719-5b902c7e80bc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:42.608393 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00f22336-ea94-4dfa-9719-5b902c7e80bc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:42.609341 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00f22336-ea94-4dfa-9719-5b902c7e80bc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:42.609770 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-00f22336-ea94-4dfa-9719-5b902c7e80bc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:42.740274 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-00f22336-ea94-4dfa-9719-5b902c7e80bc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:42.748889 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-00f22336-ea94-4dfa-9719-5b902c7e80bc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1267 microversion: 2.1 time: 0.152764 Jul 25 12:22:42.749062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 442/891] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:42 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:43.769228 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-02be6c73-aee5-4b4f-b57e-ef179195ba4c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:43.769842 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-02be6c73-aee5-4b4f-b57e-ef179195ba4c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:43.786281 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-02be6c73-aee5-4b4f-b57e-ef179195ba4c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:43.786281 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-02be6c73-aee5-4b4f-b57e-ef179195ba4c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:43.786281 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-02be6c73-aee5-4b4f-b57e-ef179195ba4c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:43.786281 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-02be6c73-aee5-4b4f-b57e-ef179195ba4c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:43.926957 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-02be6c73-aee5-4b4f-b57e-ef179195ba4c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:43.934685 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-02be6c73-aee5-4b4f-b57e-ef179195ba4c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1267 microversion: 2.1 time: 0.169342 Jul 25 12:22:43.935256 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 450/892] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:43 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:22:44.550539 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-8de80415-e77b-4348-8aea-9e83b03e0630 req-fcbcc973-93d4-4c12-90f4-0c27f7a0fd83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a", "name": "network-vif-plugged", "status": "completed", "tag": "1ad2d7c4-0c36-4f08-b535-a2075df94aa9"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:22:44.570010 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-8de80415-e77b-4348-8aea-9e83b03e0630 req-fcbcc973-93d4-4c12-90f4-0c27f7a0fd83 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:44.570461 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-8de80415-e77b-4348-8aea-9e83b03e0630 req-fcbcc973-93d4-4c12-90f4-0c27f7a0fd83 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:44.594264 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-8de80415-e77b-4348-8aea-9e83b03e0630 req-fcbcc973-93d4-4c12-90f4-0c27f7a0fd83 service nova] Creating event network-vif-plugged:1ad2d7c4-0c36-4f08-b535-a2075df94aa9 for instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a on hv-cinder-79760 Jul 25 12:22:44.605329 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-8de80415-e77b-4348-8aea-9e83b03e0630 req-fcbcc973-93d4-4c12-90f4-0c27f7a0fd83 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058782 Jul 25 12:22:44.611313 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 443/893] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:22:44.956113 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-19498f3e-1679-4c7c-95a4-03608b576df0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:44.956718 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-19498f3e-1679-4c7c-95a4-03608b576df0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:44.963300 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-19498f3e-1679-4c7c-95a4-03608b576df0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:44.963782 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-19498f3e-1679-4c7c-95a4-03608b576df0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:44.964717 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-19498f3e-1679-4c7c-95a4-03608b576df0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:44.965150 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-19498f3e-1679-4c7c-95a4-03608b576df0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:45.103708 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-19498f3e-1679-4c7c-95a4-03608b576df0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:45.111347 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-19498f3e-1679-4c7c-95a4-03608b576df0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1267 microversion: 2.1 time: 0.158956 Jul 25 12:22:45.111955 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 451/894] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:44 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:46.134285 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-cd77ab56-7d06-42b5-bb05-bbd9f5af14a2 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:46.135226 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-cd77ab56-7d06-42b5-bb05-bbd9f5af14a2 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:46.153243 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cd77ab56-7d06-42b5-bb05-bbd9f5af14a2 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:46.154549 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cd77ab56-7d06-42b5-bb05-bbd9f5af14a2 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:46.155853 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cd77ab56-7d06-42b5-bb05-bbd9f5af14a2 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:46.156406 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-cd77ab56-7d06-42b5-bb05-bbd9f5af14a2 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:46.300356 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-cd77ab56-7d06-42b5-bb05-bbd9f5af14a2 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:46.308569 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-cd77ab56-7d06-42b5-bb05-bbd9f5af14a2 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1454 microversion: 2.1 time: 0.179879 Jul 25 12:22:46.309515 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 444/895] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:46 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:46.329755 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-78a3fdc5-d361-4835-b1c3-70ffd77a55d9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:22:46.330460 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-78a3fdc5-d361-4835-b1c3-70ffd77a55d9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:22:46.336938 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78a3fdc5-d361-4835-b1c3-70ffd77a55d9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:46.337465 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78a3fdc5-d361-4835-b1c3-70ffd77a55d9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:46.338297 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78a3fdc5-d361-4835-b1c3-70ffd77a55d9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:46.338874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78a3fdc5-d361-4835-b1c3-70ffd77a55d9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:46.480580 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-78a3fdc5-d361-4835-b1c3-70ffd77a55d9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:22:46.488172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-78a3fdc5-d361-4835-b1c3-70ffd77a55d9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1454 microversion: 2.1 time: 0.162251 Jul 25 12:22:46.488765 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 452/896] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:22:46 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:22:48.407694 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-f2c40398-8b53-4c06-8cf0-d0df7ca8013f req-eefddd68-f2e9-4ad9-9da2-d51545fc44da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a", "tag": "1ad2d7c4-0c36-4f08-b535-a2075df94aa9"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:22:48.417681 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-f2c40398-8b53-4c06-8cf0-d0df7ca8013f req-eefddd68-f2e9-4ad9-9da2-d51545fc44da service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:22:48.418131 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-f2c40398-8b53-4c06-8cf0-d0df7ca8013f req-eefddd68-f2e9-4ad9-9da2-d51545fc44da service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:22:48.429396 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-f2c40398-8b53-4c06-8cf0-d0df7ca8013f req-eefddd68-f2e9-4ad9-9da2-d51545fc44da service nova] Creating event network-changed:1ad2d7c4-0c36-4f08-b535-a2075df94aa9 for instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a on hv-cinder-79760 Jul 25 12:22:48.434224 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-f2c40398-8b53-4c06-8cf0-d0df7ca8013f req-eefddd68-f2e9-4ad9-9da2-d51545fc44da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177856 Jul 25 12:22:48.435141 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 445/897] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:23:40.399431 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-922806576", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "networks": [{"uuid": "f574c424-cb6e-4798-87cc-b099251a3701"}]}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:23:40.408295 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=24 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:23:40.408959 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=60 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:23:40.453789 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] validate_networks() for [('f574c424-cb6e-4798-87cc-b099251a3701', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:23:40.885418 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:23:40.885838 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:23:40.886313 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:23:40.886721 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:23:40.887160 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:23:40.896219 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:40.896668 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:40.897466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:40.897902 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:40.914828 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Getting quotas for project a978671fc17b439eb73537f087a72e53. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:23:40.919105 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Getting quotas for user 4adc3e648c6d4bd9830dc064b9bc4e70 and project a978671fc17b439eb73537f087a72e53. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:23:40.929996 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:23:40.932264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:23:40.976951 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-94abe7cb-5582-4220-a35b-0f3ff171c481 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581496 Jul 25 12:23:40.977584 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 453/898] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:23:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:23:40.986441 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:23:40.987343 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=56 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:23:40.991980 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-890967fb-386e-4521-9b7f-35dfd7accb0f tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:23:40.992691 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-890967fb-386e-4521-9b7f-35dfd7accb0f tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:23:41.048540 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-890967fb-386e-4521-9b7f-35dfd7accb0f tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:23:41.055283 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-890967fb-386e-4521-9b7f-35dfd7accb0f tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 200 len: 1218 microversion: 2.1 time: 0.070545 Jul 25 12:23:41.055873 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 446/899] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:23:40 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:23:42.077954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a30028fc-629c-4d0d-b93f-4fb7a530f059 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:23:42.078658 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a30028fc-629c-4d0d-b93f-4fb7a530f059 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:23:42.085338 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a30028fc-629c-4d0d-b93f-4fb7a530f059 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:42.085793 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a30028fc-629c-4d0d-b93f-4fb7a530f059 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:42.086564 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a30028fc-629c-4d0d-b93f-4fb7a530f059 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:42.087002 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a30028fc-629c-4d0d-b93f-4fb7a530f059 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:42.152678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a30028fc-629c-4d0d-b93f-4fb7a530f059 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:23:42.160403 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a30028fc-629c-4d0d-b93f-4fb7a530f059 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 200 len: 1276 microversion: 2.1 time: 0.087043 Jul 25 12:23:42.160975 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 454/900] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:23:42 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:23:43.152305 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-0866673e-8ae6-4f65-8203-a522ee599b21 req-41bed047-6e0d-48fd-9afe-6a54a98fc92b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143ca885-8d64-4bfa-84f4-6ec225b06780", "tag": "e832a70d-79cf-47cb-84b4-bfa3b8bd905e"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:23:43.164312 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-0866673e-8ae6-4f65-8203-a522ee599b21 req-41bed047-6e0d-48fd-9afe-6a54a98fc92b service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:43.164763 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-0866673e-8ae6-4f65-8203-a522ee599b21 req-41bed047-6e0d-48fd-9afe-6a54a98fc92b service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:43.175772 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-0866673e-8ae6-4f65-8203-a522ee599b21 req-41bed047-6e0d-48fd-9afe-6a54a98fc92b service nova] Creating event network-changed:e832a70d-79cf-47cb-84b4-bfa3b8bd905e for instance 143ca885-8d64-4bfa-84f4-6ec225b06780 on hv-cinder-79760 Jul 25 12:23:43.180614 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-0866673e-8ae6-4f65-8203-a522ee599b21 req-41bed047-6e0d-48fd-9afe-6a54a98fc92b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033658 Jul 25 12:23:43.181671 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 447/901] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:23:43.186867 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c64a344f-0efb-4bbd-b44f-b112d103a872 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:23:43.187980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c64a344f-0efb-4bbd-b44f-b112d103a872 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:23:43.195414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c64a344f-0efb-4bbd-b44f-b112d103a872 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:43.195978 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c64a344f-0efb-4bbd-b44f-b112d103a872 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:43.197345 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c64a344f-0efb-4bbd-b44f-b112d103a872 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:43.197853 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c64a344f-0efb-4bbd-b44f-b112d103a872 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:43.331937 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c64a344f-0efb-4bbd-b44f-b112d103a872 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:23:43.340512 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c64a344f-0efb-4bbd-b44f-b112d103a872 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 200 len: 1318 microversion: 2.1 time: 0.162135 Jul 25 12:23:43.343935 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 455/902] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:23:43 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:23:44.362406 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-90a9abc3-9e3f-4757-947c-02cb86af64f9 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:23:44.363236 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-90a9abc3-9e3f-4757-947c-02cb86af64f9 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:23:44.370951 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90a9abc3-9e3f-4757-947c-02cb86af64f9 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:44.371643 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90a9abc3-9e3f-4757-947c-02cb86af64f9 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:44.372365 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90a9abc3-9e3f-4757-947c-02cb86af64f9 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:44.372899 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-90a9abc3-9e3f-4757-947c-02cb86af64f9 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:44.607234 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-90a9abc3-9e3f-4757-947c-02cb86af64f9 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:23:44.614626 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-90a9abc3-9e3f-4757-947c-02cb86af64f9 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 200 len: 1318 microversion: 2.1 time: 0.256968 Jul 25 12:23:44.615267 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 448/903] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:23:44 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:23:45.636428 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-7565ddfb-8f59-4492-8624-9674732400eb tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:23:45.636979 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-7565ddfb-8f59-4492-8624-9674732400eb tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:23:45.643380 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7565ddfb-8f59-4492-8624-9674732400eb tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:45.643858 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7565ddfb-8f59-4492-8624-9674732400eb tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:45.644871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7565ddfb-8f59-4492-8624-9674732400eb tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:45.645307 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-7565ddfb-8f59-4492-8624-9674732400eb tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:45.772085 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-7565ddfb-8f59-4492-8624-9674732400eb tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:23:45.780392 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-7565ddfb-8f59-4492-8624-9674732400eb tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 200 len: 1318 microversion: 2.1 time: 0.148477 Jul 25 12:23:45.780963 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 456/904] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:23:45 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:23:46.804019 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8500438a-85aa-442d-a847-376e2e8c0389 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:23:46.804630 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8500438a-85aa-442d-a847-376e2e8c0389 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:23:46.811100 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8500438a-85aa-442d-a847-376e2e8c0389 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:46.811561 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8500438a-85aa-442d-a847-376e2e8c0389 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:46.812340 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8500438a-85aa-442d-a847-376e2e8c0389 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:46.812748 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8500438a-85aa-442d-a847-376e2e8c0389 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:46.943877 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8500438a-85aa-442d-a847-376e2e8c0389 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:23:46.952204 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8500438a-85aa-442d-a847-376e2e8c0389 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 200 len: 1318 microversion: 2.1 time: 0.152029 Jul 25 12:23:46.952779 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 449/905] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:23:46 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:23:47.973825 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-17f3410f-9e1b-4757-acfb-48ce4844d5e1 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:23:47.974433 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-17f3410f-9e1b-4757-acfb-48ce4844d5e1 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:23:47.981611 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17f3410f-9e1b-4757-acfb-48ce4844d5e1 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:47.982065 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17f3410f-9e1b-4757-acfb-48ce4844d5e1 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:47.982823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17f3410f-9e1b-4757-acfb-48ce4844d5e1 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:47.983263 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-17f3410f-9e1b-4757-acfb-48ce4844d5e1 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:48.112840 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-17f3410f-9e1b-4757-acfb-48ce4844d5e1 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:23:48.120267 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-17f3410f-9e1b-4757-acfb-48ce4844d5e1 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 200 len: 1318 microversion: 2.1 time: 0.150310 Jul 25 12:23:48.120826 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 457/906] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:23:47 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:23:48.877372 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-3b4721d8-821c-4677-abd7-d6c7911eec57 req-f1ecfaea-5821-4287-b30a-0f341cb8eb29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143ca885-8d64-4bfa-84f4-6ec225b06780", "name": "network-vif-plugged", "status": "completed", "tag": "e832a70d-79cf-47cb-84b4-bfa3b8bd905e"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:23:48.887653 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-3b4721d8-821c-4677-abd7-d6c7911eec57 req-f1ecfaea-5821-4287-b30a-0f341cb8eb29 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:48.888040 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-3b4721d8-821c-4677-abd7-d6c7911eec57 req-f1ecfaea-5821-4287-b30a-0f341cb8eb29 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:48.899413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-3b4721d8-821c-4677-abd7-d6c7911eec57 req-f1ecfaea-5821-4287-b30a-0f341cb8eb29 service nova] Creating event network-vif-plugged:e832a70d-79cf-47cb-84b4-bfa3b8bd905e for instance 143ca885-8d64-4bfa-84f4-6ec225b06780 on hv-cinder-79760 Jul 25 12:23:48.904236 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-3b4721d8-821c-4677-abd7-d6c7911eec57 req-f1ecfaea-5821-4287-b30a-0f341cb8eb29 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030535 Jul 25 12:23:48.904819 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 450/907] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:23:49.140953 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ea971f4f-3c2f-4f61-b560-2d2a08684ade tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:23:49.141562 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ea971f4f-3c2f-4f61-b560-2d2a08684ade tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:23:49.148184 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea971f4f-3c2f-4f61-b560-2d2a08684ade tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:49.148631 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea971f4f-3c2f-4f61-b560-2d2a08684ade tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:49.149385 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea971f4f-3c2f-4f61-b560-2d2a08684ade tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:49.150397 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ea971f4f-3c2f-4f61-b560-2d2a08684ade tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:49.276122 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ea971f4f-3c2f-4f61-b560-2d2a08684ade tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:23:49.283512 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ea971f4f-3c2f-4f61-b560-2d2a08684ade tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 200 len: 1318 microversion: 2.1 time: 0.146345 Jul 25 12:23:49.284096 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 458/908] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:23:49 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:23:50.305817 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-7c3db8ef-b1e5-4703-8e83-8e123074d2dd tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:23:50.306516 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-7c3db8ef-b1e5-4703-8e83-8e123074d2dd tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:23:50.312714 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c3db8ef-b1e5-4703-8e83-8e123074d2dd tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:50.313164 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c3db8ef-b1e5-4703-8e83-8e123074d2dd tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:50.313925 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c3db8ef-b1e5-4703-8e83-8e123074d2dd tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:50.314361 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-7c3db8ef-b1e5-4703-8e83-8e123074d2dd tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:50.448731 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-7c3db8ef-b1e5-4703-8e83-8e123074d2dd tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:23:50.456443 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-7c3db8ef-b1e5-4703-8e83-8e123074d2dd tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 200 len: 1318 microversion: 2.1 time: 0.155242 Jul 25 12:23:50.471348 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 451/909] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:23:50 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:23:51.478906 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-edb4992e-b10b-4f92-906e-71b9e9918867 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:23:51.479515 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-edb4992e-b10b-4f92-906e-71b9e9918867 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:23:51.481786 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:23:51.482437 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:23:51.488389 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edb4992e-b10b-4f92-906e-71b9e9918867 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:51.488835 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edb4992e-b10b-4f92-906e-71b9e9918867 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:51.489594 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edb4992e-b10b-4f92-906e-71b9e9918867 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:23:51.490131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-edb4992e-b10b-4f92-906e-71b9e9918867 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:23:51.619502 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-edb4992e-b10b-4f92-906e-71b9e9918867 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:23:51.627175 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-edb4992e-b10b-4f92-906e-71b9e9918867 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 200 len: 1506 microversion: 2.1 time: 0.152669 Jul 25 12:23:51.627766 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 459/910] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:23:51 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:24:07.843275 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1c60aa4c-afcf-43f2-8791-e84d90aee2ea tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6493272a-c524-4874-a36c-e01b416807e9", "device": "/dev/sdb"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:24:07.846105 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1c60aa4c-afcf-43f2-8791-e84d90aee2ea tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:07.848142 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:07.848944 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=14 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:07.849485 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=22 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:07.855335 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c60aa4c-afcf-43f2-8791-e84d90aee2ea tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:07.855805 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c60aa4c-afcf-43f2-8791-e84d90aee2ea tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:07.856572 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c60aa4c-afcf-43f2-8791-e84d90aee2ea tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:07.857010 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1c60aa4c-afcf-43f2-8791-e84d90aee2ea tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:08.094976 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1c60aa4c-afcf-43f2-8791-e84d90aee2ea tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "POST /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255679 Jul 25 12:24:08.102221 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 452/911] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:24:07 2022] POST /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:24:29.692091 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-353e35ab-af50-412b-8bfa-e9471e012fad tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:29.692567 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-353e35ab-af50-412b-8bfa-e9471e012fad tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:29.695105 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:29.695887 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=38 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:29.701657 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-353e35ab-af50-412b-8bfa-e9471e012fad tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:29.702101 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-353e35ab-af50-412b-8bfa-e9471e012fad tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:29.702853 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-353e35ab-af50-412b-8bfa-e9471e012fad tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:29.703287 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-353e35ab-af50-412b-8bfa-e9471e012fad tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:29.785476 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-353e35ab-af50-412b-8bfa-e9471e012fad tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lazy-loading 'services' on Instance uuid 143ca885-8d64-4bfa-84f4-6ec225b06780 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:24:29.853675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR oslo.messaging._drivers.impl_rabbit [None req-353e35ab-af50-412b-8bfa-e9471e012fad tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [9be06d7a-25e4-4b85-b3f5-473744b4f915] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 12:24:30.861342 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [None req-353e35ab-af50-412b-8bfa-e9471e012fad tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [9be06d7a-25e4-4b85-b3f5-473744b4f915] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 46800. Jul 25 12:24:30.864996 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-353e35ab-af50-412b-8bfa-e9471e012fad tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "DELETE /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780/os-volume_attachments/6493272a-c524-4874-a36c-e01b416807e9" status: 202 len: 0 microversion: 2.1 time: 1.176820 Jul 25 12:24:30.865675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 460/912] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Jul 25 12:24:29 2022] DELETE /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780/os-volume_attachments/6493272a-c524-4874-a36c-e01b416807e9 => generated 0 bytes in 1178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:24:31.993622 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:31.994382 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:31.998459 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-38cd5a82-4d55-44d3-a4f7-618215eb4b5f tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:31.999037 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-38cd5a82-4d55-44d3-a4f7-618215eb4b5f tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:32.006315 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38cd5a82-4d55-44d3-a4f7-618215eb4b5f tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:32.006764 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38cd5a82-4d55-44d3-a4f7-618215eb4b5f tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:32.007515 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38cd5a82-4d55-44d3-a4f7-618215eb4b5f tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:32.007968 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-38cd5a82-4d55-44d3-a4f7-618215eb4b5f tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:32.033369 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-38cd5a82-4d55-44d3-a4f7-618215eb4b5f tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:24:32.107861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-38cd5a82-4d55-44d3-a4f7-618215eb4b5f tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "DELETE /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 204 len: 0 microversion: 2.1 time: 0.115278 Jul 25 12:24:32.108462 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 453/913] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:24:31 2022] DELETE /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:24:32.119636 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ab02a073-df2e-4f1e-8558-0927b38c15b5 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:32.120350 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ab02a073-df2e-4f1e-8558-0927b38c15b5 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:32.126743 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab02a073-df2e-4f1e-8558-0927b38c15b5 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:32.127192 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab02a073-df2e-4f1e-8558-0927b38c15b5 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:32.128013 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab02a073-df2e-4f1e-8558-0927b38c15b5 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:32.128456 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ab02a073-df2e-4f1e-8558-0927b38c15b5 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:32.257502 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ab02a073-df2e-4f1e-8558-0927b38c15b5 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:32.265127 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ab02a073-df2e-4f1e-8558-0927b38c15b5 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 200 len: 1512 microversion: 2.1 time: 0.151231 Jul 25 12:24:32.265714 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 461/914] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:32 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:24:33.288090 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-89d661b5-2f62-4b5a-9b69-5a7b6d5df031 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:33.288783 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-89d661b5-2f62-4b5a-9b69-5a7b6d5df031 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:33.295110 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89d661b5-2f62-4b5a-9b69-5a7b6d5df031 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:33.295554 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89d661b5-2f62-4b5a-9b69-5a7b6d5df031 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:33.296326 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89d661b5-2f62-4b5a-9b69-5a7b6d5df031 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:33.296753 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-89d661b5-2f62-4b5a-9b69-5a7b6d5df031 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:33.423784 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-89d661b5-2f62-4b5a-9b69-5a7b6d5df031 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:33.431985 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-89d661b5-2f62-4b5a-9b69-5a7b6d5df031 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 200 len: 1512 microversion: 2.1 time: 0.148717 Jul 25 12:24:33.432539 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 454/915] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:33 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:24:34.145688 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-5618dfff-c8d5-4823-873b-fc437e1f5b51 req-0f93ab2a-8034-492a-830e-dbbeec95e865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143ca885-8d64-4bfa-84f4-6ec225b06780", "name": "network-vif-deleted", "tag": "e832a70d-79cf-47cb-84b4-bfa3b8bd905e"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:24:34.156439 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-5618dfff-c8d5-4823-873b-fc437e1f5b51 req-0f93ab2a-8034-492a-830e-dbbeec95e865 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:34.156874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-5618dfff-c8d5-4823-873b-fc437e1f5b51 req-0f93ab2a-8034-492a-830e-dbbeec95e865 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:34.319340 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-5618dfff-c8d5-4823-873b-fc437e1f5b51 req-0f93ab2a-8034-492a-830e-dbbeec95e865 service nova] Creating event network-vif-deleted:e832a70d-79cf-47cb-84b4-bfa3b8bd905e for instance 143ca885-8d64-4bfa-84f4-6ec225b06780 on hv-cinder-79760 Jul 25 12:24:34.324297 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-5618dfff-c8d5-4823-873b-fc437e1f5b51 req-0f93ab2a-8034-492a-830e-dbbeec95e865 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182557 Jul 25 12:24:34.324881 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 462/916] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:24:34.456363 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-599e1388-c6fc-4813-95d4-6847d7725225 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:34.456983 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-599e1388-c6fc-4813-95d4-6847d7725225 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:34.463461 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-599e1388-c6fc-4813-95d4-6847d7725225 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:34.463943 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-599e1388-c6fc-4813-95d4-6847d7725225 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:34.464709 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-599e1388-c6fc-4813-95d4-6847d7725225 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:34.465145 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-599e1388-c6fc-4813-95d4-6847d7725225 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:34.499025 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-599e1388-c6fc-4813-95d4-6847d7725225 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:34.499804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-599e1388-c6fc-4813-95d4-6847d7725225 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:34.499804 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-599e1388-c6fc-4813-95d4-6847d7725225 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lazy-loading 'fault' on Instance uuid 143ca885-8d64-4bfa-84f4-6ec225b06780 {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:24:34.545489 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-599e1388-c6fc-4813-95d4-6847d7725225 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:34.555178 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-599e1388-c6fc-4813-95d4-6847d7725225 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 200 len: 1308 microversion: 2.1 time: 0.102567 Jul 25 12:24:34.555778 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 455/917] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:34 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:24:35.578241 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aa8b5c23-cb0a-44f3-b375-ef9fdb89046a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:35.578868 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-aa8b5c23-cb0a-44f3-b375-ef9fdb89046a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: 143ca885-8d64-4bfa-84f4-6ec225b06780] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:35.585954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa8b5c23-cb0a-44f3-b375-ef9fdb89046a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:35.586400 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa8b5c23-cb0a-44f3-b375-ef9fdb89046a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:35.587157 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa8b5c23-cb0a-44f3-b375-ef9fdb89046a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:35.587616 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-aa8b5c23-cb0a-44f3-b375-ef9fdb89046a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:35.600716 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-aa8b5c23-cb0a-44f3-b375-ef9fdb89046a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] HTTP exception thrown: Instance 143ca885-8d64-4bfa-84f4-6ec225b06780 could not be found. Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aa8b5c23-cb0a-44f3-b375-ef9fdb89046a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Request method failure captured: Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 HTTP/1.1 Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3otKZWSKP4mpcb8yRfGjWX15BOrafKDcauRueJ3Q95L19tKBzKK2pmnr0Kdg-CaXb6D7lmKbcMxjPve203RoISBil-wkf57CWhGq4RMKY20_RuKMI02an2Q4WmRqqCeBgYEt7qihikZr846PxkDETZH7lQuOEgeCrUrWvcwlDIKuP7c Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: a978671fc17b439eb73537f087a72e53 Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesSnapshotTestJSON-549768596 Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:24:35.602293 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:24:35.604026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a978671fc17b439eb73537f087a72e53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a978671fc17b439eb73537f087a72e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a978671fc17b439eb73537f087a72e53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a978671fc17b439eb73537f087a72e53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:24:35.604026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesSnapshotTestJSON-549768596 Jul 25 12:24:35.604026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: a978671fc17b439eb73537f087a72e53 Jul 25 12:24:35.604026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-549768596 Jul 25 12:24:35.604026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesSnapshotTestJSON-549768596-project Jul 25 12:24:35.604026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:24:35.604026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:24:35.604026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 4adc3e648c6d4bd9830dc064b9bc4e70 Jul 25 12:24:35.604026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesSnapshotTestJSON-549768596-project Jul 25 12:24:35.604026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:24:35.604026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 143ca885-8d64-4bfa-84f4-6ec225b06780 could not be found. Jul 25 12:24:35.604026 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '143ca885-8d64-4bfa-84f4-6ec225b06780'} Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143ca885-8d64-4bfa-84f4-6ec225b06780 could not be found. Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:24:35.605172 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143ca885-8d64-4bfa-84f4-6ec225b06780 could not be found. Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143ca885-8d64-4bfa-84f4-6ec225b06780 could not be found. Jul 25 12:24:35.606851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:24:35.608288 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-aa8b5c23-cb0a-44f3-b375-ef9fdb89046a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Returning 404 to user: Instance 143ca885-8d64-4bfa-84f4-6ec225b06780 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:24:35.608288 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-aa8b5c23-cb0a-44f3-b375-ef9fdb89046a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780" status: 404 len: 111 microversion: 2.1 time: 0.030167 Jul 25 12:24:35.608288 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 463/918] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:35 2022] GET /compute/v2.1/servers/143ca885-8d64-4bfa-84f4-6ec225b06780 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:24:43.376738 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1354054299", "imageRef": "234b0ce9-ee4a-4935-8082-e06d14bf0ed5", "flavorRef": "452", "networks": [{"uuid": "f574c424-cb6e-4798-87cc-b099251a3701"}]}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:24:43.584947 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] validate_networks() for [('f574c424-cb6e-4798-87cc-b099251a3701', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:24:44.166249 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:24:44.166671 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:24:44.167145 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:24:44.167568 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:24:44.167999 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:24:44.177560 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:44.178183 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:44.178567 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:44.178997 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:44.197003 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Getting quotas for project a978671fc17b439eb73537f087a72e53. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:24:44.200824 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Getting quotas for user 4adc3e648c6d4bd9830dc064b9bc4e70 and project a978671fc17b439eb73537f087a72e53. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:24:44.211361 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:24:44.213619 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='234b0ce9-ee4a-4935-8082-e06d14bf0ed5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:24:44.259071 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-73d7d420-a39f-4d11-8eed-11648f975c86 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886121 Jul 25 12:24:44.265566 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 456/919] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:24:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:24:44.271179 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d982ff6c-86f9-4184-8e3c-29945a2730c6 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:44.271827 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d982ff6c-86f9-4184-8e3c-29945a2730c6 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:44.379130 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d982ff6c-86f9-4184-8e3c-29945a2730c6 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:44.386688 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d982ff6c-86f9-4184-8e3c-29945a2730c6 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 200 len: 1219 microversion: 2.1 time: 0.119787 Jul 25 12:24:44.387328 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 464/920] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:44 2022] GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:24:45.408925 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b38a04e3-b336-45e7-9734-9f0eb7a1346b tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:45.409544 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b38a04e3-b336-45e7-9734-9f0eb7a1346b tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:45.416312 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b38a04e3-b336-45e7-9734-9f0eb7a1346b tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:45.416764 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b38a04e3-b336-45e7-9734-9f0eb7a1346b tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:45.417532 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b38a04e3-b336-45e7-9734-9f0eb7a1346b tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:45.417970 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b38a04e3-b336-45e7-9734-9f0eb7a1346b tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:45.485051 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b38a04e3-b336-45e7-9734-9f0eb7a1346b tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:45.492943 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b38a04e3-b336-45e7-9734-9f0eb7a1346b tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 200 len: 1277 microversion: 2.1 time: 0.088532 Jul 25 12:24:45.493508 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 457/921] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:45 2022] GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:24:45.930125 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:24:45.930724 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Mon Jul 25 12:24:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:24:46.440710 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-37cbbc5d-0097-4279-9cc6-780131e89316 req-2c7c39e4-a773-4218-b5b2-ce7097b2b405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6578504-23f0-49e5-906d-62ad6b318f72", "tag": "8cdf9d22-ddd5-40a8-b17d-665d35a9142c"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:24:46.447113 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:46.453647 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-37cbbc5d-0097-4279-9cc6-780131e89316 req-2c7c39e4-a773-4218-b5b2-ce7097b2b405 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:46.454351 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-37cbbc5d-0097-4279-9cc6-780131e89316 req-2c7c39e4-a773-4218-b5b2-ce7097b2b405 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:46.472135 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-37cbbc5d-0097-4279-9cc6-780131e89316 req-2c7c39e4-a773-4218-b5b2-ce7097b2b405 service nova] Creating event network-changed:8cdf9d22-ddd5-40a8-b17d-665d35a9142c for instance b6578504-23f0-49e5-906d-62ad6b318f72 on hv-cinder-79760 Jul 25 12:24:46.477533 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-37cbbc5d-0097-4279-9cc6-780131e89316 req-2c7c39e4-a773-4218-b5b2-ce7097b2b405 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040554 Jul 25 12:24:46.478132 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 465/922] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:24:46.514398 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8f59523a-ec56-4b3c-8b16-0f7b444fa719 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:46.514999 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8f59523a-ec56-4b3c-8b16-0f7b444fa719 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:46.522414 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8f59523a-ec56-4b3c-8b16-0f7b444fa719 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:46.522864 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8f59523a-ec56-4b3c-8b16-0f7b444fa719 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:46.524336 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8f59523a-ec56-4b3c-8b16-0f7b444fa719 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:46.524764 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8f59523a-ec56-4b3c-8b16-0f7b444fa719 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:46.750491 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8f59523a-ec56-4b3c-8b16-0f7b444fa719 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:46.758299 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8f59523a-ec56-4b3c-8b16-0f7b444fa719 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 200 len: 1319 microversion: 2.1 time: 0.247917 Jul 25 12:24:46.758860 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 458/923] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:46 2022] GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:24:47.781631 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-125f9af4-166a-4e55-9029-86b5d86d7ed8 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:47.782376 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-125f9af4-166a-4e55-9029-86b5d86d7ed8 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:47.789117 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-125f9af4-166a-4e55-9029-86b5d86d7ed8 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:47.789580 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-125f9af4-166a-4e55-9029-86b5d86d7ed8 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:47.790341 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-125f9af4-166a-4e55-9029-86b5d86d7ed8 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:47.790770 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-125f9af4-166a-4e55-9029-86b5d86d7ed8 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:47.921229 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-125f9af4-166a-4e55-9029-86b5d86d7ed8 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:47.928558 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-125f9af4-166a-4e55-9029-86b5d86d7ed8 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 200 len: 1319 microversion: 2.1 time: 0.152926 Jul 25 12:24:47.929106 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 466/924] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:47 2022] GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:24:48.949365 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d9b03641-1a95-40ac-a1f8-8b6533e75b4e tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:48.949977 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d9b03641-1a95-40ac-a1f8-8b6533e75b4e tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:48.956584 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9b03641-1a95-40ac-a1f8-8b6533e75b4e tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:48.957060 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9b03641-1a95-40ac-a1f8-8b6533e75b4e tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:48.957825 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9b03641-1a95-40ac-a1f8-8b6533e75b4e tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:48.958304 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d9b03641-1a95-40ac-a1f8-8b6533e75b4e tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:49.087083 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d9b03641-1a95-40ac-a1f8-8b6533e75b4e tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:49.094628 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d9b03641-1a95-40ac-a1f8-8b6533e75b4e tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 200 len: 1319 microversion: 2.1 time: 0.149168 Jul 25 12:24:49.095177 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 459/925] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:48 2022] GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:24:50.117009 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e121b1b1-2139-4f8d-8e14-a7ff67ce267d tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:50.117649 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e121b1b1-2139-4f8d-8e14-a7ff67ce267d tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:50.124094 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e121b1b1-2139-4f8d-8e14-a7ff67ce267d tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:50.124555 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e121b1b1-2139-4f8d-8e14-a7ff67ce267d tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:50.125321 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e121b1b1-2139-4f8d-8e14-a7ff67ce267d tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:50.125758 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e121b1b1-2139-4f8d-8e14-a7ff67ce267d tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:50.256556 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e121b1b1-2139-4f8d-8e14-a7ff67ce267d tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:50.264553 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e121b1b1-2139-4f8d-8e14-a7ff67ce267d tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 200 len: 1319 microversion: 2.1 time: 0.152089 Jul 25 12:24:50.265480 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 467/926] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:50 2022] GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:24:51.217915 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-22bbb5fe-c656-46db-aca8-43d390ddaa8f req-78981ab3-b915-40ae-ae8b-fed758ced875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6578504-23f0-49e5-906d-62ad6b318f72", "name": "network-vif-plugged", "status": "completed", "tag": "8cdf9d22-ddd5-40a8-b17d-665d35a9142c"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:24:51.228200 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-22bbb5fe-c656-46db-aca8-43d390ddaa8f req-78981ab3-b915-40ae-ae8b-fed758ced875 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:51.228640 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-22bbb5fe-c656-46db-aca8-43d390ddaa8f req-78981ab3-b915-40ae-ae8b-fed758ced875 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:51.239672 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-22bbb5fe-c656-46db-aca8-43d390ddaa8f req-78981ab3-b915-40ae-ae8b-fed758ced875 service nova] Creating event network-vif-plugged:8cdf9d22-ddd5-40a8-b17d-665d35a9142c for instance b6578504-23f0-49e5-906d-62ad6b318f72 on hv-cinder-79760 Jul 25 12:24:51.244520 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-22bbb5fe-c656-46db-aca8-43d390ddaa8f req-78981ab3-b915-40ae-ae8b-fed758ced875 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030202 Jul 25 12:24:51.245096 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 460/927] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:24:51.286556 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-44f23d3b-912d-40cd-a369-ec1928389eba tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:51.288686 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-44f23d3b-912d-40cd-a369-ec1928389eba tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:51.295679 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44f23d3b-912d-40cd-a369-ec1928389eba tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:51.296142 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44f23d3b-912d-40cd-a369-ec1928389eba tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:51.296936 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44f23d3b-912d-40cd-a369-ec1928389eba tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:51.297447 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-44f23d3b-912d-40cd-a369-ec1928389eba tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:51.432629 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-44f23d3b-912d-40cd-a369-ec1928389eba tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:51.440201 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-44f23d3b-912d-40cd-a369-ec1928389eba tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 200 len: 1319 microversion: 2.1 time: 0.157697 Jul 25 12:24:51.440769 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 468/928] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:51 2022] GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:24:52.463719 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-57b5d95d-b271-4c8b-a151-c69147f8b148 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:52.464424 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-57b5d95d-b271-4c8b-a151-c69147f8b148 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:52.470623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57b5d95d-b271-4c8b-a151-c69147f8b148 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:52.471079 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57b5d95d-b271-4c8b-a151-c69147f8b148 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:52.471880 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57b5d95d-b271-4c8b-a151-c69147f8b148 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:52.472318 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-57b5d95d-b271-4c8b-a151-c69147f8b148 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:52.599984 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-57b5d95d-b271-4c8b-a151-c69147f8b148 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:52.607302 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-57b5d95d-b271-4c8b-a151-c69147f8b148 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 200 len: 1319 microversion: 2.1 time: 0.148348 Jul 25 12:24:52.607888 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 461/929] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:52 2022] GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:24:53.627710 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ba8d62ad-3612-45f5-8d66-ba3c0c88a53a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:53.628323 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ba8d62ad-3612-45f5-8d66-ba3c0c88a53a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:53.634764 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ba8d62ad-3612-45f5-8d66-ba3c0c88a53a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:53.635211 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ba8d62ad-3612-45f5-8d66-ba3c0c88a53a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:53.636001 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ba8d62ad-3612-45f5-8d66-ba3c0c88a53a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:53.636434 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ba8d62ad-3612-45f5-8d66-ba3c0c88a53a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:53.761742 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ba8d62ad-3612-45f5-8d66-ba3c0c88a53a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:53.769271 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ba8d62ad-3612-45f5-8d66-ba3c0c88a53a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 200 len: 1507 microversion: 2.1 time: 0.145411 Jul 25 12:24:53.770408 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 469/930] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:53 2022] GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:24:53.790760 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-97b9b9ba-5c47-4a4d-8ba8-6d83b75a2384 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "049e98a7-ffdf-4a6e-9435-ad26009bbb60", "device": "/dev/sdb"}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:24:53.793243 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-97b9b9ba-5c47-4a4d-8ba8-6d83b75a2384 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:53.799697 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97b9b9ba-5c47-4a4d-8ba8-6d83b75a2384 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:53.800151 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97b9b9ba-5c47-4a4d-8ba8-6d83b75a2384 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:53.800936 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97b9b9ba-5c47-4a4d-8ba8-6d83b75a2384 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:53.801373 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-97b9b9ba-5c47-4a4d-8ba8-6d83b75a2384 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:54.026916 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-97b9b9ba-5c47-4a4d-8ba8-6d83b75a2384 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "POST /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239895 Jul 25 12:24:54.027674 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 462/931] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Jul 25 12:24:53 2022] POST /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:24:56.700415 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:24:56.701049 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Mon Jul 25 12:24:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:24:58.052739 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-84eb9184-4885-4b35-a945-5b514f00b36d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:58.053274 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-84eb9184-4885-4b35-a945-5b514f00b36d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:58.055214 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:58.061020 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84eb9184-4885-4b35-a945-5b514f00b36d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:58.061471 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84eb9184-4885-4b35-a945-5b514f00b36d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:58.062238 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84eb9184-4885-4b35-a945-5b514f00b36d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:58.062675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-84eb9184-4885-4b35-a945-5b514f00b36d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:58.089430 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-84eb9184-4885-4b35-a945-5b514f00b36d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:24:58.164390 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-84eb9184-4885-4b35-a945-5b514f00b36d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 204 len: 0 microversion: 2.1 time: 0.115018 Jul 25 12:24:58.165333 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 470/932] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:24:58 2022] DELETE /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:24:58.174502 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1323d2c2-e49a-4dcd-9576-b34df306a215 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:58.175202 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1323d2c2-e49a-4dcd-9576-b34df306a215 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:58.179603 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:58.180818 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:58.189211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1323d2c2-e49a-4dcd-9576-b34df306a215 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:58.189786 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1323d2c2-e49a-4dcd-9576-b34df306a215 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:58.190563 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1323d2c2-e49a-4dcd-9576-b34df306a215 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:58.191008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1323d2c2-e49a-4dcd-9576-b34df306a215 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:58.325692 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1323d2c2-e49a-4dcd-9576-b34df306a215 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:58.333201 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1323d2c2-e49a-4dcd-9576-b34df306a215 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1578 microversion: 2.1 time: 0.162963 Jul 25 12:24:58.333752 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 463/933] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:58 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:24:59.354774 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a40466a9-c707-4a07-92d8-6d7d051f35a8 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:24:59.355484 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a40466a9-c707-4a07-92d8-6d7d051f35a8 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:24:59.361892 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a40466a9-c707-4a07-92d8-6d7d051f35a8 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:59.362347 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a40466a9-c707-4a07-92d8-6d7d051f35a8 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:59.363115 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a40466a9-c707-4a07-92d8-6d7d051f35a8 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:24:59.363758 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a40466a9-c707-4a07-92d8-6d7d051f35a8 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:24:59.493131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a40466a9-c707-4a07-92d8-6d7d051f35a8 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:24:59.500820 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a40466a9-c707-4a07-92d8-6d7d051f35a8 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1578 microversion: 2.1 time: 0.150414 Jul 25 12:24:59.501399 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 471/934] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:24:59 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:00.522656 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-404093b8-bdb8-40ba-bd2c-1b2524eaa42a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:00.523594 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-404093b8-bdb8-40ba-bd2c-1b2524eaa42a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:00.530604 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-404093b8-bdb8-40ba-bd2c-1b2524eaa42a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:00.531143 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-404093b8-bdb8-40ba-bd2c-1b2524eaa42a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:00.532206 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-404093b8-bdb8-40ba-bd2c-1b2524eaa42a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:00.532866 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-404093b8-bdb8-40ba-bd2c-1b2524eaa42a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:00.764128 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-404093b8-bdb8-40ba-bd2c-1b2524eaa42a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:00.772096 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-404093b8-bdb8-40ba-bd2c-1b2524eaa42a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1578 microversion: 2.1 time: 0.253280 Jul 25 12:25:00.785492 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 464/935] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:00 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1578 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:01.406975 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-46de8b4e-b761-4644-b060-55e6c240503f req-25ed5b6f-3433-4e58-8154-b39b6f660199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a", "name": "network-vif-deleted", "tag": "1ad2d7c4-0c36-4f08-b535-a2075df94aa9"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:25:01.413523 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:25:01.419159 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-46de8b4e-b761-4644-b060-55e6c240503f req-25ed5b6f-3433-4e58-8154-b39b6f660199 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:01.419624 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-46de8b4e-b761-4644-b060-55e6c240503f req-25ed5b6f-3433-4e58-8154-b39b6f660199 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:01.438457 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-46de8b4e-b761-4644-b060-55e6c240503f req-25ed5b6f-3433-4e58-8154-b39b6f660199 service nova] Creating event network-vif-deleted:1ad2d7c4-0c36-4f08-b535-a2075df94aa9 for instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a on hv-cinder-79760 Jul 25 12:25:01.443566 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-46de8b4e-b761-4644-b060-55e6c240503f req-25ed5b6f-3433-4e58-8154-b39b6f660199 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040262 Jul 25 12:25:01.444174 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 472/936] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:25:01.793289 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b4e1971e-d0b3-4fca-a732-7710b7550fce tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:01.793910 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b4e1971e-d0b3-4fca-a732-7710b7550fce tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:01.800775 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4e1971e-d0b3-4fca-a732-7710b7550fce tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:01.801322 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4e1971e-d0b3-4fca-a732-7710b7550fce tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:01.802071 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4e1971e-d0b3-4fca-a732-7710b7550fce tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:01.802683 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b4e1971e-d0b3-4fca-a732-7710b7550fce tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:01.867452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b4e1971e-d0b3-4fca-a732-7710b7550fce tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:01.875458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b4e1971e-d0b3-4fca-a732-7710b7550fce tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1226 microversion: 2.1 time: 0.086308 Jul 25 12:25:01.876062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 465/937] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:01 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:02.897856 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a8446da8-b074-4290-b213-2c13dd502d2b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:02.898491 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a8446da8-b074-4290-b213-2c13dd502d2b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:02.904702 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8446da8-b074-4290-b213-2c13dd502d2b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:02.905158 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8446da8-b074-4290-b213-2c13dd502d2b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:02.905921 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8446da8-b074-4290-b213-2c13dd502d2b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:02.906359 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a8446da8-b074-4290-b213-2c13dd502d2b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:02.969822 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-a8446da8-b074-4290-b213-2c13dd502d2b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:02.977256 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a8446da8-b074-4290-b213-2c13dd502d2b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1226 microversion: 2.1 time: 0.084166 Jul 25 12:25:02.977815 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 473/938] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:02 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:03.998291 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e6a55d5f-b1cf-442a-a2f0-3a865f0e287c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:03.998819 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e6a55d5f-b1cf-442a-a2f0-3a865f0e287c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:04.001122 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:25:04.006905 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6a55d5f-b1cf-442a-a2f0-3a865f0e287c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:04.007357 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6a55d5f-b1cf-442a-a2f0-3a865f0e287c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:04.008147 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6a55d5f-b1cf-442a-a2f0-3a865f0e287c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:04.008584 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6a55d5f-b1cf-442a-a2f0-3a865f0e287c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:04.013332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:25:04.043425 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6a55d5f-b1cf-442a-a2f0-3a865f0e287c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:04.043902 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e6a55d5f-b1cf-442a-a2f0-3a865f0e287c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:04.044357 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-e6a55d5f-b1cf-442a-a2f0-3a865f0e287c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lazy-loading 'fault' on Instance uuid f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:25:04.085811 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e6a55d5f-b1cf-442a-a2f0-3a865f0e287c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:04.093280 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e6a55d5f-b1cf-442a-a2f0-3a865f0e287c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 200 len: 1231 microversion: 2.1 time: 0.098938 Jul 25 12:25:04.093838 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 466/939] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:03 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:05.113849 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-505468af-1e2e-4409-90ad-94bdb2723728 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:05.114486 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-505468af-1e2e-4409-90ad-94bdb2723728 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:05.120898 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-505468af-1e2e-4409-90ad-94bdb2723728 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:05.121340 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-505468af-1e2e-4409-90ad-94bdb2723728 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:05.122089 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-505468af-1e2e-4409-90ad-94bdb2723728 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:05.122521 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-505468af-1e2e-4409-90ad-94bdb2723728 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:05.135416 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-505468af-1e2e-4409-90ad-94bdb2723728 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] HTTP exception thrown: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-505468af-1e2e-4409-90ad-94bdb2723728 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Request method failure captured: Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a HTTP/1.1 Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3orbQVzhDsWVUKbWg3qiCpVhDwiGmxa5cV1nRTNN_-QLHjSv_Xcj_SvuujIapOhKCXSh5t1GBsK3oRW5WN-jVGpVKqd9bLuf3FU0lK0-gPVow9xZ4iR9H-d55wNqE3hZKsnxHV52Vp5u2eMpv7Qk9IJr8khZ2-5OK-zGihaNisr3KJ0 Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 141003bbc94b41569683aef4c15b46f1 Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:25:05.137057 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:25:05.138803 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_141003bbc94b41569683aef4c15b46f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:25:05.138803 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:25:05.138803 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 141003bbc94b41569683aef4c15b46f1 Jul 25 12:25:05.138803 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:25:05.138803 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-TestVolumeBootPattern-1028467132-project Jul 25 12:25:05.138803 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:25:05.138803 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:25:05.138803 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 3494ce75df62497bb737254fd1665a3b Jul 25 12:25:05.138803 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-TestVolumeBootPattern-1028467132-project Jul 25 12:25:05.138803 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:25:05.138803 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:25:05.138803 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': 'f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a'} Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:25:05.139799 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:25:05.141414 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:25:05.142645 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-505468af-1e2e-4409-90ad-94bdb2723728 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Returning 404 to user: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:25:05.142645 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-505468af-1e2e-4409-90ad-94bdb2723728 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 404 len: 111 microversion: 2.1 time: 0.028492 Jul 25 12:25:05.142645 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 474/940] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:05 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:25:05.235862 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-930192583", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1809500551", "security_groups": [{"name": "tempest-secgroup-smoke-1054820741"}], "block_device_mapping_v2": [{"uuid": "4a7d406a-19e7-4e78-8d16-fc63623a0aae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11d8ce76-c85a-44ea-b9a3-bfb714066192"}]}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:25:05.348987 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] validate_networks() for [('11d8ce76-c85a-44ea-b9a3-bfb714066192', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:25:05.713477 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:25:05.713902 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:25:05.714377 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:25:05.714812 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:25:05.715225 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:25:05.723958 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:05.724407 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:05.725204 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:05.725642 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:05.742414 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Getting quotas for project 141003bbc94b41569683aef4c15b46f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:25:05.746351 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Getting quotas for user 3494ce75df62497bb737254fd1665a3b and project 141003bbc94b41569683aef4c15b46f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:25:05.803001 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:25:05.805120 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a7d406a-19e7-4e78-8d16-fc63623a0aae',volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:25:05.932332 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4313d6b7-487b-4387-985f-0beda680dd2f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700417 Jul 25 12:25:05.933112 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 467/941] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:25:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:25:05.944547 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-63170a78-a552-4d53-944f-62f98b3de429 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:05.945160 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-63170a78-a552-4d53-944f-62f98b3de429 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:05.996407 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-63170a78-a552-4d53-944f-62f98b3de429 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:06.002908 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-63170a78-a552-4d53-944f-62f98b3de429 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1094 microversion: 2.1 time: 0.063087 Jul 25 12:25:06.003466 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 475/942] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:05 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:07.025252 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-69fc6f5a-dad3-4a73-9430-3261291b08d1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:07.025859 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-69fc6f5a-dad3-4a73-9430-3261291b08d1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:07.032591 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69fc6f5a-dad3-4a73-9430-3261291b08d1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:07.032974 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69fc6f5a-dad3-4a73-9430-3261291b08d1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:07.033724 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69fc6f5a-dad3-4a73-9430-3261291b08d1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:07.034149 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-69fc6f5a-dad3-4a73-9430-3261291b08d1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:07.092999 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-69fc6f5a-dad3-4a73-9430-3261291b08d1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:07.100313 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-69fc6f5a-dad3-4a73-9430-3261291b08d1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1144 microversion: 2.1 time: 0.079402 Jul 25 12:25:07.100897 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 468/943] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:07 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:08.120751 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3440ca13-53da-4fc7-932f-a045f1123575 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:08.121380 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3440ca13-53da-4fc7-932f-a045f1123575 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:08.128478 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3440ca13-53da-4fc7-932f-a045f1123575 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:08.128914 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3440ca13-53da-4fc7-932f-a045f1123575 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:08.129696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3440ca13-53da-4fc7-932f-a045f1123575 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:08.130127 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3440ca13-53da-4fc7-932f-a045f1123575 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:08.191270 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-3440ca13-53da-4fc7-932f-a045f1123575 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:08.203192 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3440ca13-53da-4fc7-932f-a045f1123575 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1192 microversion: 2.1 time: 0.086122 Jul 25 12:25:08.203820 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 476/944] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:08 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:09.226960 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-17b6626f-eda4-4372-ad91-c382c141a98c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:09.227595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-17b6626f-eda4-4372-ad91-c382c141a98c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:09.233754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17b6626f-eda4-4372-ad91-c382c141a98c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:09.234278 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17b6626f-eda4-4372-ad91-c382c141a98c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:09.234967 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17b6626f-eda4-4372-ad91-c382c141a98c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:09.235421 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17b6626f-eda4-4372-ad91-c382c141a98c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:09.416180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-17b6626f-eda4-4372-ad91-c382c141a98c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:09.423614 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-17b6626f-eda4-4372-ad91-c382c141a98c tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1266 microversion: 2.1 time: 0.201128 Jul 25 12:25:09.424197 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 469/945] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:09 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:09.738535 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-4262feb0-d905-41a8-b384-af012dbc30a4 req-17970d98-bfcb-4ad4-bcfe-ae595c50ac7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680a227e-0e1f-4221-ad9e-30b6eec96cb9", "tag": "ab330dd9-8cf2-465a-938e-753b7c9e645a"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:25:09.753028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-4262feb0-d905-41a8-b384-af012dbc30a4 req-17970d98-bfcb-4ad4-bcfe-ae595c50ac7b service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:09.753474 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-4262feb0-d905-41a8-b384-af012dbc30a4 req-17970d98-bfcb-4ad4-bcfe-ae595c50ac7b service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:09.776358 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-4262feb0-d905-41a8-b384-af012dbc30a4 req-17970d98-bfcb-4ad4-bcfe-ae595c50ac7b service nova] Creating event network-changed:ab330dd9-8cf2-465a-938e-753b7c9e645a for instance 680a227e-0e1f-4221-ad9e-30b6eec96cb9 on hv-cinder-79760 Jul 25 12:25:09.787177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-4262feb0-d905-41a8-b384-af012dbc30a4 req-17970d98-bfcb-4ad4-bcfe-ae595c50ac7b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052361 Jul 25 12:25:09.787971 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 477/946] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:25:10.450533 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9bf7e298-0b80-45af-8a27-71ef3c56248a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:10.451144 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9bf7e298-0b80-45af-8a27-71ef3c56248a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:10.457455 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bf7e298-0b80-45af-8a27-71ef3c56248a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:10.457903 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bf7e298-0b80-45af-8a27-71ef3c56248a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:10.458704 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bf7e298-0b80-45af-8a27-71ef3c56248a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:10.459139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9bf7e298-0b80-45af-8a27-71ef3c56248a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:10.676791 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9bf7e298-0b80-45af-8a27-71ef3c56248a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:10.684231 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9bf7e298-0b80-45af-8a27-71ef3c56248a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1266 microversion: 2.1 time: 0.237639 Jul 25 12:25:10.684797 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 470/947] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:10 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:11.299387 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-3cf22201-d2ff-451b-83b4-54a4e377ba21 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:11.300000 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-3cf22201-d2ff-451b-83b4-54a4e377ba21 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:11.306228 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3cf22201-d2ff-451b-83b4-54a4e377ba21 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:11.306680 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3cf22201-d2ff-451b-83b4-54a4e377ba21 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:11.307444 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3cf22201-d2ff-451b-83b4-54a4e377ba21 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:11.307907 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-3cf22201-d2ff-451b-83b4-54a4e377ba21 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:11.388331 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-3cf22201-d2ff-451b-83b4-54a4e377ba21 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lazy-loading 'services' on Instance uuid b6578504-23f0-49e5-906d-62ad6b318f72 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:25:11.458315 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-3cf22201-d2ff-451b-83b4-54a4e377ba21 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72/os-volume_attachments/049e98a7-ffdf-4a6e-9435-ad26009bbb60" status: 202 len: 0 microversion: 2.1 time: 0.163323 Jul 25 12:25:11.458894 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 478/948] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Jul 25 12:25:11 2022] DELETE /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72/os-volume_attachments/049e98a7-ffdf-4a6e-9435-ad26009bbb60 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:25:11.704923 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-07fb5a98-db6e-4fff-8a1d-7cfb18737fb9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:11.705535 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-07fb5a98-db6e-4fff-8a1d-7cfb18737fb9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:11.712690 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07fb5a98-db6e-4fff-8a1d-7cfb18737fb9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:11.713137 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07fb5a98-db6e-4fff-8a1d-7cfb18737fb9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:11.713891 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07fb5a98-db6e-4fff-8a1d-7cfb18737fb9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:11.714324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-07fb5a98-db6e-4fff-8a1d-7cfb18737fb9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:11.843183 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-07fb5a98-db6e-4fff-8a1d-7cfb18737fb9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:11.850661 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-07fb5a98-db6e-4fff-8a1d-7cfb18737fb9 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1266 microversion: 2.1 time: 0.149602 Jul 25 12:25:11.851406 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 471/949] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:11 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:12.577317 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-92c3ca1a-7ba6-4350-b612-dd48f09032ed tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:12.577909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-92c3ca1a-7ba6-4350-b612-dd48f09032ed tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:12.584651 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92c3ca1a-7ba6-4350-b612-dd48f09032ed tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:12.585103 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92c3ca1a-7ba6-4350-b612-dd48f09032ed tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:12.585868 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92c3ca1a-7ba6-4350-b612-dd48f09032ed tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:12.586310 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-92c3ca1a-7ba6-4350-b612-dd48f09032ed tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:12.610872 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-92c3ca1a-7ba6-4350-b612-dd48f09032ed tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:25:12.685248 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-92c3ca1a-7ba6-4350-b612-dd48f09032ed tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 204 len: 0 microversion: 2.1 time: 0.112309 Jul 25 12:25:12.685824 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 479/950] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:25:12 2022] DELETE /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:25:12.694882 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c99ec4db-241b-48e9-be8b-062d38de3ad7 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:12.695492 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c99ec4db-241b-48e9-be8b-062d38de3ad7 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:12.701446 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c99ec4db-241b-48e9-be8b-062d38de3ad7 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:12.701895 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c99ec4db-241b-48e9-be8b-062d38de3ad7 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:12.702659 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c99ec4db-241b-48e9-be8b-062d38de3ad7 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:12.703091 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c99ec4db-241b-48e9-be8b-062d38de3ad7 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:12.837077 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c99ec4db-241b-48e9-be8b-062d38de3ad7 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:12.844491 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c99ec4db-241b-48e9-be8b-062d38de3ad7 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 200 len: 1513 microversion: 2.1 time: 0.153504 Jul 25 12:25:12.845043 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 472/951] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:12 2022] GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:12.871987 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-ecf125a1-fdd3-4c0f-b34a-b2756cd13f33 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:12.872693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-ecf125a1-fdd3-4c0f-b34a-b2756cd13f33 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:12.878665 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ecf125a1-fdd3-4c0f-b34a-b2756cd13f33 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:12.879117 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ecf125a1-fdd3-4c0f-b34a-b2756cd13f33 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:12.880403 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ecf125a1-fdd3-4c0f-b34a-b2756cd13f33 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:12.880844 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-ecf125a1-fdd3-4c0f-b34a-b2756cd13f33 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:13.009568 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-ecf125a1-fdd3-4c0f-b34a-b2756cd13f33 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:13.017314 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-ecf125a1-fdd3-4c0f-b34a-b2756cd13f33 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1266 microversion: 2.1 time: 0.149513 Jul 25 12:25:13.017874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 480/952] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:12 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:13.865969 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-de5da9dc-e107-4edc-9904-d35df0628771 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:13.866583 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-de5da9dc-e107-4edc-9904-d35df0628771 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:13.873170 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de5da9dc-e107-4edc-9904-d35df0628771 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:13.873622 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de5da9dc-e107-4edc-9904-d35df0628771 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:13.874421 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de5da9dc-e107-4edc-9904-d35df0628771 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:13.874876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de5da9dc-e107-4edc-9904-d35df0628771 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:14.001102 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-de5da9dc-e107-4edc-9904-d35df0628771 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:14.009156 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-de5da9dc-e107-4edc-9904-d35df0628771 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 200 len: 1513 microversion: 2.1 time: 0.147094 Jul 25 12:25:14.009722 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 473/953] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:13 2022] GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:14.038136 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-61c7196a-47e8-41f2-8e7d-49b41038890a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:14.038681 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-61c7196a-47e8-41f2-8e7d-49b41038890a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:14.045033 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61c7196a-47e8-41f2-8e7d-49b41038890a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:14.045478 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61c7196a-47e8-41f2-8e7d-49b41038890a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:14.046256 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61c7196a-47e8-41f2-8e7d-49b41038890a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:14.046685 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-61c7196a-47e8-41f2-8e7d-49b41038890a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:14.050645 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:25:14.187405 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-61c7196a-47e8-41f2-8e7d-49b41038890a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:14.199856 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-61c7196a-47e8-41f2-8e7d-49b41038890a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1266 microversion: 2.1 time: 0.165546 Jul 25 12:25:14.200426 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 481/954] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:14 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:14.739907 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-6d7e7442-727b-4415-bbe6-5f5ca5aae6f9 req-892333a1-5cdb-4aae-b496-768388260d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6578504-23f0-49e5-906d-62ad6b318f72", "name": "network-vif-deleted", "tag": "8cdf9d22-ddd5-40a8-b17d-665d35a9142c"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:25:14.751182 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-6d7e7442-727b-4415-bbe6-5f5ca5aae6f9 req-892333a1-5cdb-4aae-b496-768388260d49 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:14.751664 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-6d7e7442-727b-4415-bbe6-5f5ca5aae6f9 req-892333a1-5cdb-4aae-b496-768388260d49 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:14.763168 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-6d7e7442-727b-4415-bbe6-5f5ca5aae6f9 req-892333a1-5cdb-4aae-b496-768388260d49 service nova] Creating event network-vif-deleted:8cdf9d22-ddd5-40a8-b17d-665d35a9142c for instance b6578504-23f0-49e5-906d-62ad6b318f72 on hv-cinder-79760 Jul 25 12:25:14.768268 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-6d7e7442-727b-4415-bbe6-5f5ca5aae6f9 req-892333a1-5cdb-4aae-b496-768388260d49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032331 Jul 25 12:25:14.768856 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 474/955] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:25:15.030424 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4765a650-5b5b-4178-bff7-9f5ed58956a3 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:15.030961 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4765a650-5b5b-4178-bff7-9f5ed58956a3 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:15.037607 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4765a650-5b5b-4178-bff7-9f5ed58956a3 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:15.038061 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4765a650-5b5b-4178-bff7-9f5ed58956a3 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:15.038826 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4765a650-5b5b-4178-bff7-9f5ed58956a3 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:15.039360 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4765a650-5b5b-4178-bff7-9f5ed58956a3 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:15.071533 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4765a650-5b5b-4178-bff7-9f5ed58956a3 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:15.072030 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4765a650-5b5b-4178-bff7-9f5ed58956a3 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:15.072481 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-4765a650-5b5b-4178-bff7-9f5ed58956a3 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lazy-loading 'fault' on Instance uuid b6578504-23f0-49e5-906d-62ad6b318f72 {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:25:15.113748 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-4765a650-5b5b-4178-bff7-9f5ed58956a3 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adc3e648c6d4bd9830dc064b9bc4e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a978671fc17b439eb73537f087a72e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:15.122523 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4765a650-5b5b-4178-bff7-9f5ed58956a3 tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 200 len: 1309 microversion: 2.1 time: 0.096142 Jul 25 12:25:15.123111 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 482/956] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:15 2022] GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:15.221605 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-17f98c0f-9e6c-4722-9a98-ca94c800e640 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:15.222307 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-17f98c0f-9e6c-4722-9a98-ca94c800e640 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:15.228539 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17f98c0f-9e6c-4722-9a98-ca94c800e640 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:15.229018 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17f98c0f-9e6c-4722-9a98-ca94c800e640 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:15.230198 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17f98c0f-9e6c-4722-9a98-ca94c800e640 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:15.230638 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17f98c0f-9e6c-4722-9a98-ca94c800e640 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:15.360181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-17f98c0f-9e6c-4722-9a98-ca94c800e640 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:15.367693 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-17f98c0f-9e6c-4722-9a98-ca94c800e640 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1266 microversion: 2.1 time: 0.150679 Jul 25 12:25:15.368257 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 475/957] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:15 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:16.144125 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8aad4875-6890-4fea-a12a-0c7edd32124a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:16.144737 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8aad4875-6890-4fea-a12a-0c7edd32124a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] [instance: b6578504-23f0-49e5-906d-62ad6b318f72] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:16.146586 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:25:16.152795 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8aad4875-6890-4fea-a12a-0c7edd32124a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:16.153038 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8aad4875-6890-4fea-a12a-0c7edd32124a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:16.153800 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8aad4875-6890-4fea-a12a-0c7edd32124a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:16.154298 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8aad4875-6890-4fea-a12a-0c7edd32124a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:16.167863 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-8aad4875-6890-4fea-a12a-0c7edd32124a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] HTTP exception thrown: Instance b6578504-23f0-49e5-906d-62ad6b318f72 could not be found. Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8aad4875-6890-4fea-a12a-0c7edd32124a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Request method failure captured: Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 HTTP/1.1 Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3otKZWSKP4mpcb8yRfGjWX15BOrafKDcauRueJ3Q95L19tKBzKK2pmnr0Kdg-CaXb6D7lmKbcMxjPve203RoISBil-wkf57CWhGq4RMKY20_RuKMI02an2Q4WmRqqCeBgYEt7qihikZr846PxkDETZH7lQuOEgeCrUrWvcwlDIKuP7c Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: a978671fc17b439eb73537f087a72e53 Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-VolumesSnapshotTestJSON-549768596 Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:25:16.169505 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:25:16.170883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a978671fc17b439eb73537f087a72e53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a978671fc17b439eb73537f087a72e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a978671fc17b439eb73537f087a72e53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a978671fc17b439eb73537f087a72e53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:25:16.170883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-VolumesSnapshotTestJSON-549768596 Jul 25 12:25:16.170883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: a978671fc17b439eb73537f087a72e53 Jul 25 12:25:16.170883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-549768596 Jul 25 12:25:16.170883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-VolumesSnapshotTestJSON-549768596-project Jul 25 12:25:16.170883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:25:16.170883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:25:16.170883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 4adc3e648c6d4bd9830dc064b9bc4e70 Jul 25 12:25:16.170883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-VolumesSnapshotTestJSON-549768596-project Jul 25 12:25:16.170883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:25:16.170883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance b6578504-23f0-49e5-906d-62ad6b318f72 could not be found. Jul 25 12:25:16.170883 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': 'b6578504-23f0-49e5-906d-62ad6b318f72'} Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6578504-23f0-49e5-906d-62ad6b318f72 could not be found. Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:25:16.171678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6578504-23f0-49e5-906d-62ad6b318f72 could not be found. Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6578504-23f0-49e5-906d-62ad6b318f72 could not be found. Jul 25 12:25:16.173208 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:25:16.174538 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8aad4875-6890-4fea-a12a-0c7edd32124a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] Returning 404 to user: Instance b6578504-23f0-49e5-906d-62ad6b318f72 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:25:16.174538 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8aad4875-6890-4fea-a12a-0c7edd32124a tempest-VolumesSnapshotTestJSON-549768596 tempest-VolumesSnapshotTestJSON-549768596-project] 10.222.0.42 "GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72" status: 404 len: 111 microversion: 2.1 time: 0.030926 Jul 25 12:25:16.174538 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 483/958] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:16 2022] GET /compute/v2.1/servers/b6578504-23f0-49e5-906d-62ad6b318f72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:25:16.390139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9fdc41c5-dd5a-42d4-95bd-31240c8b715e tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:16.391166 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9fdc41c5-dd5a-42d4-95bd-31240c8b715e tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:16.393290 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:25:16.394062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:25:16.403434 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fdc41c5-dd5a-42d4-95bd-31240c8b715e tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:16.403955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fdc41c5-dd5a-42d4-95bd-31240c8b715e tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:16.404732 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fdc41c5-dd5a-42d4-95bd-31240c8b715e tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:16.405172 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9fdc41c5-dd5a-42d4-95bd-31240c8b715e tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:16.548754 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9fdc41c5-dd5a-42d4-95bd-31240c8b715e tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:16.556265 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9fdc41c5-dd5a-42d4-95bd-31240c8b715e tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1266 microversion: 2.1 time: 0.170941 Jul 25 12:25:16.556830 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 476/959] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:16 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:17.577213 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-85c114c0-fd47-4e6e-8e8a-7bfcc689a0dd tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:17.577821 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-85c114c0-fd47-4e6e-8e8a-7bfcc689a0dd tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:17.584518 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85c114c0-fd47-4e6e-8e8a-7bfcc689a0dd tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:17.584941 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85c114c0-fd47-4e6e-8e8a-7bfcc689a0dd tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:17.585709 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85c114c0-fd47-4e6e-8e8a-7bfcc689a0dd tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:17.586152 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-85c114c0-fd47-4e6e-8e8a-7bfcc689a0dd tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:17.725581 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-85c114c0-fd47-4e6e-8e8a-7bfcc689a0dd tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:17.733146 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-85c114c0-fd47-4e6e-8e8a-7bfcc689a0dd tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1266 microversion: 2.1 time: 0.159781 Jul 25 12:25:17.733704 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 484/960] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:17 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:18.755606 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-db28e533-27cd-4608-99cb-4cbc67a69c74 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:18.756204 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-db28e533-27cd-4608-99cb-4cbc67a69c74 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:18.762636 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db28e533-27cd-4608-99cb-4cbc67a69c74 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:18.763035 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db28e533-27cd-4608-99cb-4cbc67a69c74 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:18.763813 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db28e533-27cd-4608-99cb-4cbc67a69c74 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:18.764236 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-db28e533-27cd-4608-99cb-4cbc67a69c74 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:18.879443 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-f7b406a1-b295-4966-9410-25e294e59c03 req-17b3daf8-dd71-45ec-869e-30ef3810e772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680a227e-0e1f-4221-ad9e-30b6eec96cb9", "name": "network-vif-plugged", "status": "completed", "tag": "ab330dd9-8cf2-465a-938e-753b7c9e645a"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:25:18.890910 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-f7b406a1-b295-4966-9410-25e294e59c03 req-17b3daf8-dd71-45ec-869e-30ef3810e772 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:18.891364 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-f7b406a1-b295-4966-9410-25e294e59c03 req-17b3daf8-dd71-45ec-869e-30ef3810e772 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:18.901021 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-db28e533-27cd-4608-99cb-4cbc67a69c74 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:18.903299 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-f7b406a1-b295-4966-9410-25e294e59c03 req-17b3daf8-dd71-45ec-869e-30ef3810e772 service nova] Creating event network-vif-plugged:ab330dd9-8cf2-465a-938e-753b7c9e645a for instance 680a227e-0e1f-4221-ad9e-30b6eec96cb9 on hv-cinder-79760 Jul 25 12:25:18.908411 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-f7b406a1-b295-4966-9410-25e294e59c03 req-17b3daf8-dd71-45ec-869e-30ef3810e772 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032613 Jul 25 12:25:18.909001 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 485/961] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:25:18.909891 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-db28e533-27cd-4608-99cb-4cbc67a69c74 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1266 microversion: 2.1 time: 0.158775 Jul 25 12:25:18.911049 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 477/962] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:18 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:19.932104 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2f2eb4b5-857e-4659-ba12-fe5323700cdc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:19.932807 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2f2eb4b5-857e-4659-ba12-fe5323700cdc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:19.939089 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f2eb4b5-857e-4659-ba12-fe5323700cdc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:19.939562 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f2eb4b5-857e-4659-ba12-fe5323700cdc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:19.940324 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f2eb4b5-857e-4659-ba12-fe5323700cdc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:19.940760 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2f2eb4b5-857e-4659-ba12-fe5323700cdc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:20.073219 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2f2eb4b5-857e-4659-ba12-fe5323700cdc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:20.080681 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2f2eb4b5-857e-4659-ba12-fe5323700cdc tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1266 microversion: 2.1 time: 0.153332 Jul 25 12:25:20.081239 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 486/963] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:19 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:21.101305 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4c8ff219-1355-4def-acbe-73c9a1ff6f15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:21.101909 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4c8ff219-1355-4def-acbe-73c9a1ff6f15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:21.108344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4c8ff219-1355-4def-acbe-73c9a1ff6f15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:21.108777 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4c8ff219-1355-4def-acbe-73c9a1ff6f15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:21.109532 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4c8ff219-1355-4def-acbe-73c9a1ff6f15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:21.109960 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4c8ff219-1355-4def-acbe-73c9a1ff6f15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:21.242062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4c8ff219-1355-4def-acbe-73c9a1ff6f15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:21.249510 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4c8ff219-1355-4def-acbe-73c9a1ff6f15 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1266 microversion: 2.1 time: 0.152302 Jul 25 12:25:21.250069 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 478/964] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:21 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:22.271125 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-53af3eb1-909f-4850-a131-7aeaf50b16d5 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:22.272037 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-53af3eb1-909f-4850-a131-7aeaf50b16d5 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:22.282190 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-53af3eb1-909f-4850-a131-7aeaf50b16d5 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:22.282640 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-53af3eb1-909f-4850-a131-7aeaf50b16d5 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:22.283403 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-53af3eb1-909f-4850-a131-7aeaf50b16d5 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:22.283865 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-53af3eb1-909f-4850-a131-7aeaf50b16d5 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:22.417707 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-53af3eb1-909f-4850-a131-7aeaf50b16d5 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:22.426858 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-53af3eb1-909f-4850-a131-7aeaf50b16d5 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1453 microversion: 2.1 time: 0.160297 Jul 25 12:25:22.427420 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 487/965] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:22 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:22.449641 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-e8e75e27-c20f-42b3-a611-abcfb615771f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:25:22.450279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-e8e75e27-c20f-42b3-a611-abcfb615771f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:25:22.460008 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8e75e27-c20f-42b3-a611-abcfb615771f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:22.460459 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8e75e27-c20f-42b3-a611-abcfb615771f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:22.461227 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8e75e27-c20f-42b3-a611-abcfb615771f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:22.461672 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-e8e75e27-c20f-42b3-a611-abcfb615771f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:22.593173 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-e8e75e27-c20f-42b3-a611-abcfb615771f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:25:22.600676 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-e8e75e27-c20f-42b3-a611-abcfb615771f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1453 microversion: 2.1 time: 0.157001 Jul 25 12:25:22.601234 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 479/966] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:25:22 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:25:24.411913 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-39860aba-76b2-49d4-b99a-cfbd3c5e5d3d req-ad64c923-42a8-4416-833f-ba3ec00a66a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680a227e-0e1f-4221-ad9e-30b6eec96cb9", "tag": "ab330dd9-8cf2-465a-938e-753b7c9e645a"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:25:24.421909 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-39860aba-76b2-49d4-b99a-cfbd3c5e5d3d req-ad64c923-42a8-4416-833f-ba3ec00a66a9 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:25:24.422438 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-39860aba-76b2-49d4-b99a-cfbd3c5e5d3d req-ad64c923-42a8-4416-833f-ba3ec00a66a9 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:25:24.433837 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-39860aba-76b2-49d4-b99a-cfbd3c5e5d3d req-ad64c923-42a8-4416-833f-ba3ec00a66a9 service nova] Creating event network-changed:ab330dd9-8cf2-465a-938e-753b7c9e645a for instance 680a227e-0e1f-4221-ad9e-30b6eec96cb9 on hv-cinder-79760 Jul 25 12:25:24.438767 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-39860aba-76b2-49d4-b99a-cfbd3c5e5d3d req-ad64c923-42a8-4416-833f-ba3ec00a66a9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030744 Jul 25 12:25:24.439364 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 488/967] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:25:47.982656 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:25:47.984460 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=77 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:25:48.169877 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b00fd14d-3fa4-4f54-b49b-1f2687f2040d tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Action: 'create', calling method: .version_select at 0x7f942c3393a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-785289464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB0f6jYp283XmM9Yu59/velFN0QL75ZaA15ICGEdCtVQr1+f4GeNyBQvj+g2HmzrIrEXZ2IotiJhpedF2BWaluMMv4Wx2ViEmNOGhs6sB1+MWqYoNi2JGvg65tce3CL4w=="}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:25:48.186384 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-b00fd14d-3fa4-4f54-b49b-1f2687f2040d tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Getting quotas for project 376f79202b2d46b4bff1b67d8b10add6. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:25:48.190648 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-b00fd14d-3fa4-4f54-b49b-1f2687f2040d tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Getting quotas for user edb6dd7dc1af4bc79386df797dab6e1e and project 376f79202b2d46b4bff1b67d8b10add6. Resources: {'key_pairs'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:25:48.217472 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b00fd14d-3fa4-4f54-b49b-1f2687f2040d tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.239587 Jul 25 12:25:48.218230 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 480/968] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Jul 25 12:25:47 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:26:03.320819 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:26:03.321562 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=36 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:26:03.325875 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2127356543", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-785289464", "security_groups": [{"name": "tempest-secgroup-smoke-264783640"}], "networks": [{"uuid": "e9ac5d0d-b0c8-425e-b600-fc0f4ed3b228"}], "block_device_mapping_v2": [{"uuid": "9da6beb1-2be2-41ad-97a5-fb70b2c521bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:26:03.437780 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.network.neutron [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] validate_networks() for [('e9ac5d0d-b0c8-425e-b600-fc0f4ed3b228', None, None, None, None, None)] {{(pid=117777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:26:03.814698 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Flavor limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:26:03.815143 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Image limits 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:26:03.815670 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Flavor pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:26:03.816115 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Image pref 0:0:0 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:26:03.816523 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.virt.hardware [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:26:03.825751 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:03.826201 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:03.827069 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:03.827522 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:03.844775 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Getting quotas for project 376f79202b2d46b4bff1b67d8b10add6. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:26:03.848706 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.quota [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Getting quotas for user edb6dd7dc1af4bc79386df797dab6e1e and project 376f79202b2d46b4bff1b67d8b10add6. Resources: {'ram', 'cores', 'instances'} {{(pid=117777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:26:03.904987 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Going to run 1 instances... {{(pid=117777) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:26:03.907173 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9da6beb1-2be2-41ad-97a5-fb70b2c521bd',volume_size=None,volume_type=None)] {{(pid=117777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:26:04.030361 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [6da78316-868c-491d-a200-d5129b3388ed] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 12:26:05.039669 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [6da78316-868c-491d-a200-d5129b3388ed] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 47402. Jul 25 12:26:05.043983 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b0cde457-c1e2-45c6-8284-56ec349186a9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.724910 Jul 25 12:26:05.044649 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 489/969] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:26:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:26:05.053440 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=4 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:26:05.054176 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:26:05.058422 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-85c31667-00b1-439f-a462-a402f954fc04 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:05.059028 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-85c31667-00b1-439f-a462-a402f954fc04 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:05.113403 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-85c31667-00b1-439f-a462-a402f954fc04 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:05.120885 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-85c31667-00b1-439f-a462-a402f954fc04 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1088 microversion: 2.1 time: 0.068776 Jul 25 12:26:05.121450 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 481/970] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:05 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:06.142643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-987451f7-e7a0-4307-b4ae-49f8a2fa6de1 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:06.143422 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-987451f7-e7a0-4307-b4ae-49f8a2fa6de1 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:06.150614 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-987451f7-e7a0-4307-b4ae-49f8a2fa6de1 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:06.151071 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-987451f7-e7a0-4307-b4ae-49f8a2fa6de1 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:06.151881 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-987451f7-e7a0-4307-b4ae-49f8a2fa6de1 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:06.152325 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-987451f7-e7a0-4307-b4ae-49f8a2fa6de1 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:06.214334 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-987451f7-e7a0-4307-b4ae-49f8a2fa6de1 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:06.221775 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-987451f7-e7a0-4307-b4ae-49f8a2fa6de1 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1204 microversion: 2.1 time: 0.083539 Jul 25 12:26:06.222343 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 490/971] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:06 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1204 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:07.242262 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-526f2155-0d1b-44ac-9ed1-6a0143fa8393 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:07.242874 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-526f2155-0d1b-44ac-9ed1-6a0143fa8393 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:07.250211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-526f2155-0d1b-44ac-9ed1-6a0143fa8393 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:07.251158 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-526f2155-0d1b-44ac-9ed1-6a0143fa8393 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:07.252000 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-526f2155-0d1b-44ac-9ed1-6a0143fa8393 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:07.252379 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-526f2155-0d1b-44ac-9ed1-6a0143fa8393 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:07.428210 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-5e0c37cb-1188-4b82-a68e-0c0784d5f22e req-36363bf6-8281-4089-9b74-f99870a1dd6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1a52c51-3bf0-49e4-b87f-6917ff4807df", "tag": "ce9adc4d-f014-4c86-ab08-37edf3c4210e"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:26:07.439637 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-5e0c37cb-1188-4b82-a68e-0c0784d5f22e req-36363bf6-8281-4089-9b74-f99870a1dd6b service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:07.440267 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-5e0c37cb-1188-4b82-a68e-0c0784d5f22e req-36363bf6-8281-4089-9b74-f99870a1dd6b service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:07.455778 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-5e0c37cb-1188-4b82-a68e-0c0784d5f22e req-36363bf6-8281-4089-9b74-f99870a1dd6b service nova] Creating event network-changed:ce9adc4d-f014-4c86-ab08-37edf3c4210e for instance d1a52c51-3bf0-49e4-b87f-6917ff4807df on hv-cinder-79760 Jul 25 12:26:07.462521 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-5e0c37cb-1188-4b82-a68e-0c0784d5f22e req-36363bf6-8281-4089-9b74-f99870a1dd6b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115485 Jul 25 12:26:07.463489 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 491/972] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:26:07.519066 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-526f2155-0d1b-44ac-9ed1-6a0143fa8393 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:07.527050 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-526f2155-0d1b-44ac-9ed1-6a0143fa8393 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1259 microversion: 2.1 time: 0.288730 Jul 25 12:26:07.527635 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 482/973] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:07 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1259 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:08.549328 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c385d63a-4970-45b6-829b-cae1ee1dfc1f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:08.550028 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c385d63a-4970-45b6-829b-cae1ee1dfc1f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:08.556475 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c385d63a-4970-45b6-829b-cae1ee1dfc1f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:08.556927 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c385d63a-4970-45b6-829b-cae1ee1dfc1f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:08.557699 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c385d63a-4970-45b6-829b-cae1ee1dfc1f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:08.558165 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c385d63a-4970-45b6-829b-cae1ee1dfc1f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:08.689577 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c385d63a-4970-45b6-829b-cae1ee1dfc1f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:08.698115 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c385d63a-4970-45b6-829b-cae1ee1dfc1f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1259 microversion: 2.1 time: 0.153438 Jul 25 12:26:08.698693 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 492/974] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:08 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:09.718978 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1025bfcf-a1ce-4289-aa0e-dac7fea0f332 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:09.719513 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1025bfcf-a1ce-4289-aa0e-dac7fea0f332 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:09.726308 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1025bfcf-a1ce-4289-aa0e-dac7fea0f332 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:09.726762 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1025bfcf-a1ce-4289-aa0e-dac7fea0f332 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:09.727526 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1025bfcf-a1ce-4289-aa0e-dac7fea0f332 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:09.727986 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1025bfcf-a1ce-4289-aa0e-dac7fea0f332 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:09.856570 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1025bfcf-a1ce-4289-aa0e-dac7fea0f332 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:09.863921 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1025bfcf-a1ce-4289-aa0e-dac7fea0f332 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1259 microversion: 2.1 time: 0.148907 Jul 25 12:26:09.864490 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 483/975] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:09 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:10.885450 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-12aa5ccf-a7ac-4e66-b72a-fd9495f25061 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:10.886059 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-12aa5ccf-a7ac-4e66-b72a-fd9495f25061 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:10.892643 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12aa5ccf-a7ac-4e66-b72a-fd9495f25061 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:10.893089 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12aa5ccf-a7ac-4e66-b72a-fd9495f25061 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:10.893845 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12aa5ccf-a7ac-4e66-b72a-fd9495f25061 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:10.894274 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-12aa5ccf-a7ac-4e66-b72a-fd9495f25061 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:11.025398 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-12aa5ccf-a7ac-4e66-b72a-fd9495f25061 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:11.032809 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-12aa5ccf-a7ac-4e66-b72a-fd9495f25061 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1259 microversion: 2.1 time: 0.151216 Jul 25 12:26:11.033332 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 493/976] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:10 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:12.053468 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-de9067aa-bc3d-4c0a-85cf-e71ea5bfebcf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:12.054086 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-de9067aa-bc3d-4c0a-85cf-e71ea5bfebcf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:12.060607 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de9067aa-bc3d-4c0a-85cf-e71ea5bfebcf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:12.061065 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de9067aa-bc3d-4c0a-85cf-e71ea5bfebcf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:12.061823 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de9067aa-bc3d-4c0a-85cf-e71ea5bfebcf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:12.062261 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-de9067aa-bc3d-4c0a-85cf-e71ea5bfebcf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:12.192014 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-de9067aa-bc3d-4c0a-85cf-e71ea5bfebcf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:12.199405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-de9067aa-bc3d-4c0a-85cf-e71ea5bfebcf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1259 microversion: 2.1 time: 0.149804 Jul 25 12:26:12.199997 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 484/977] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:12 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:13.221808 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-b4cc84e2-ad28-4143-ab19-62523400ceca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:13.222339 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-b4cc84e2-ad28-4143-ab19-62523400ceca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:13.228793 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4cc84e2-ad28-4143-ab19-62523400ceca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:13.229240 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4cc84e2-ad28-4143-ab19-62523400ceca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:13.229996 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4cc84e2-ad28-4143-ab19-62523400ceca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:13.230429 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-b4cc84e2-ad28-4143-ab19-62523400ceca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:13.358394 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-b4cc84e2-ad28-4143-ab19-62523400ceca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:13.366278 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-b4cc84e2-ad28-4143-ab19-62523400ceca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1259 microversion: 2.1 time: 0.148961 Jul 25 12:26:13.366840 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 494/978] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:13 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:14.386820 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-92b118d5-b1b3-4485-9a94-9991a8d75b6a tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:14.387514 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-92b118d5-b1b3-4485-9a94-9991a8d75b6a tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:14.396388 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92b118d5-b1b3-4485-9a94-9991a8d75b6a tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:14.397494 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92b118d5-b1b3-4485-9a94-9991a8d75b6a tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:14.399709 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92b118d5-b1b3-4485-9a94-9991a8d75b6a tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:14.400181 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-92b118d5-b1b3-4485-9a94-9991a8d75b6a tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:14.527526 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-92b118d5-b1b3-4485-9a94-9991a8d75b6a tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:14.535405 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-92b118d5-b1b3-4485-9a94-9991a8d75b6a tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1259 microversion: 2.1 time: 0.152470 Jul 25 12:26:14.535999 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 485/979] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:14 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:15.556182 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e62870ae-140f-40d3-9faa-d73c776a954e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:15.556788 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e62870ae-140f-40d3-9faa-d73c776a954e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:15.558719 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:26:15.559367 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=6 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:26:15.566344 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e62870ae-140f-40d3-9faa-d73c776a954e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:15.566787 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e62870ae-140f-40d3-9faa-d73c776a954e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:15.567572 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e62870ae-140f-40d3-9faa-d73c776a954e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:15.567993 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e62870ae-140f-40d3-9faa-d73c776a954e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:15.710767 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e62870ae-140f-40d3-9faa-d73c776a954e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:15.718205 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e62870ae-140f-40d3-9faa-d73c776a954e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1259 microversion: 2.1 time: 0.165819 Jul 25 12:26:15.718761 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 495/980] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:15 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:16.740000 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9aed9b68-9f3e-48a9-a7cb-1023b7192553 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:16.740512 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9aed9b68-9f3e-48a9-a7cb-1023b7192553 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:16.742366 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:26:16.748182 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9aed9b68-9f3e-48a9-a7cb-1023b7192553 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:16.748623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9aed9b68-9f3e-48a9-a7cb-1023b7192553 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:16.749371 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9aed9b68-9f3e-48a9-a7cb-1023b7192553 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:16.749794 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9aed9b68-9f3e-48a9-a7cb-1023b7192553 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:16.879963 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9aed9b68-9f3e-48a9-a7cb-1023b7192553 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:16.887287 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9aed9b68-9f3e-48a9-a7cb-1023b7192553 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1259 microversion: 2.1 time: 0.151883 Jul 25 12:26:16.888012 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 486/981] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:16 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:17.233810 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-7808b1f8-6ea3-44ac-b005-c293fdc301c6 req-28f8984c-648a-4f35-a4bc-6c533356cd53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a52c51-3bf0-49e4-b87f-6917ff4807df", "name": "network-vif-plugged", "status": "completed", "tag": "ce9adc4d-f014-4c86-ab08-37edf3c4210e"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:26:17.243194 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-7808b1f8-6ea3-44ac-b005-c293fdc301c6 req-28f8984c-648a-4f35-a4bc-6c533356cd53 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:17.243655 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-7808b1f8-6ea3-44ac-b005-c293fdc301c6 req-28f8984c-648a-4f35-a4bc-6c533356cd53 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:17.254690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-7808b1f8-6ea3-44ac-b005-c293fdc301c6 req-28f8984c-648a-4f35-a4bc-6c533356cd53 service nova] Creating event network-vif-plugged:ce9adc4d-f014-4c86-ab08-37edf3c4210e for instance d1a52c51-3bf0-49e4-b87f-6917ff4807df on hv-cinder-79760 Jul 25 12:26:17.259538 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-7808b1f8-6ea3-44ac-b005-c293fdc301c6 req-28f8984c-648a-4f35-a4bc-6c533356cd53 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086469 Jul 25 12:26:17.260212 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 496/982] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:26:17.909255 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5603a373-cef8-4351-aa59-e99cca1d74ef tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:17.909866 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5603a373-cef8-4351-aa59-e99cca1d74ef tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:17.916353 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5603a373-cef8-4351-aa59-e99cca1d74ef tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:17.916798 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5603a373-cef8-4351-aa59-e99cca1d74ef tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:17.917555 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5603a373-cef8-4351-aa59-e99cca1d74ef tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:17.917991 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5603a373-cef8-4351-aa59-e99cca1d74ef tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:18.055335 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5603a373-cef8-4351-aa59-e99cca1d74ef tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:18.062827 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5603a373-cef8-4351-aa59-e99cca1d74ef tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1259 microversion: 2.1 time: 0.157485 Jul 25 12:26:18.063381 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 487/983] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:17 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:19.085822 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0150eb5c-5454-4562-a877-b4c58ddfb923 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:19.086548 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0150eb5c-5454-4562-a877-b4c58ddfb923 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:19.092751 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0150eb5c-5454-4562-a877-b4c58ddfb923 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:19.093196 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0150eb5c-5454-4562-a877-b4c58ddfb923 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:19.093947 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0150eb5c-5454-4562-a877-b4c58ddfb923 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:19.094407 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0150eb5c-5454-4562-a877-b4c58ddfb923 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:19.225017 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0150eb5c-5454-4562-a877-b4c58ddfb923 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:19.232772 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0150eb5c-5454-4562-a877-b4c58ddfb923 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1442 microversion: 2.1 time: 0.152270 Jul 25 12:26:19.233362 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 497/984] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:19 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:19.256269 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-4e294fec-d549-43b6-aad0-458795444aca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:26:19.256877 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-4e294fec-d549-43b6-aad0-458795444aca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:26:19.263232 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e294fec-d549-43b6-aad0-458795444aca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:19.263719 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e294fec-d549-43b6-aad0-458795444aca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:19.264466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e294fec-d549-43b6-aad0-458795444aca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:19.264891 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-4e294fec-d549-43b6-aad0-458795444aca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:19.394861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-4e294fec-d549-43b6-aad0-458795444aca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:26:19.402573 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-4e294fec-d549-43b6-aad0-458795444aca tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1442 microversion: 2.1 time: 0.150332 Jul 25 12:26:19.403122 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 488/985] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:26:19 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1442 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:26:21.318049 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-6e94edee-4a36-4a70-a62e-e3f04a2d951f req-ec741527-fda9-4710-8662-33381aacf3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1a52c51-3bf0-49e4-b87f-6917ff4807df", "tag": "ce9adc4d-f014-4c86-ab08-37edf3c4210e"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:26:21.327986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-6e94edee-4a36-4a70-a62e-e3f04a2d951f req-ec741527-fda9-4710-8662-33381aacf3a7 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:26:21.328440 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-6e94edee-4a36-4a70-a62e-e3f04a2d951f req-ec741527-fda9-4710-8662-33381aacf3a7 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:26:21.342170 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-6e94edee-4a36-4a70-a62e-e3f04a2d951f req-ec741527-fda9-4710-8662-33381aacf3a7 service nova] Creating event network-changed:ce9adc4d-f014-4c86-ab08-37edf3c4210e for instance d1a52c51-3bf0-49e4-b87f-6917ff4807df on hv-cinder-79760 Jul 25 12:26:21.347484 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-6e94edee-4a36-4a70-a62e-e3f04a2d951f req-ec741527-fda9-4710-8662-33381aacf3a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033129 Jul 25 12:26:21.348117 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 498/986] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:27:11.562595 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1502153393", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1809500551", "security_groups": [{"name": "tempest-secgroup-smoke-1054820741"}], "block_device_mapping_v2": [{"uuid": "99d6dddc-c407-44b8-a129-ff9afd084e17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11d8ce76-c85a-44ea-b9a3-bfb714066192"}]}} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:27:11.572553 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=18 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:27:11.573188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=42 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:27:11.676918 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.network.neutron [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] validate_networks() for [('11d8ce76-c85a-44ea-b9a3-bfb714066192', None, None, None, None, None)] {{(pid=117776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:27:12.033450 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Flavor limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:27:12.033857 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Image limits 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:27:12.034324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Flavor pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:27:12.034719 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Image pref 0:0:0 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:27:12.035118 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.virt.hardware [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:27:12.044301 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:12.044736 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:12.045517 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:12.045945 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:12.062679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Getting quotas for project 141003bbc94b41569683aef4c15b46f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:27:12.066468 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.quota [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Getting quotas for user 3494ce75df62497bb737254fd1665a3b and project 141003bbc94b41569683aef4c15b46f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:27:12.121572 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Going to run 1 instances... {{(pid=117776) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:27:12.123695 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99d6dddc-c407-44b8-a129-ff9afd084e17',volume_size=None,volume_type=None)] {{(pid=117776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:27:12.246932 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-05b35035-a46c-4b51-800c-c2a5bfd2fbdf tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.688282 Jul 25 12:27:12.247831 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 489/987] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Jul 25 12:27:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:27:12.256725 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:27:12.257467 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=44 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:27:12.261896 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c35f6ddb-ba14-4a77-af06-823040a891ff tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:12.262603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c35f6ddb-ba14-4a77-af06-823040a891ff tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:12.318857 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c35f6ddb-ba14-4a77-af06-823040a891ff tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:12.326188 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c35f6ddb-ba14-4a77-af06-823040a891ff tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1095 microversion: 2.1 time: 0.071209 Jul 25 12:27:12.326744 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 499/988] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:12 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:13.349006 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-9588ca0c-7475-4885-a289-d069580c4ed1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:13.349625 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-9588ca0c-7475-4885-a289-d069580c4ed1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:13.356509 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9588ca0c-7475-4885-a289-d069580c4ed1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:13.356964 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9588ca0c-7475-4885-a289-d069580c4ed1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:13.357745 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9588ca0c-7475-4885-a289-d069580c4ed1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:13.358180 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-9588ca0c-7475-4885-a289-d069580c4ed1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:13.427729 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-9588ca0c-7475-4885-a289-d069580c4ed1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:13.435573 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-9588ca0c-7475-4885-a289-d069580c4ed1 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1211 microversion: 2.1 time: 0.091045 Jul 25 12:27:13.436183 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 490/989] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:13 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:14.457040 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-0032271d-c458-494b-8b39-448573638335 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:14.457650 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-0032271d-c458-494b-8b39-448573638335 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:14.464892 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0032271d-c458-494b-8b39-448573638335 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:14.465571 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0032271d-c458-494b-8b39-448573638335 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:14.466355 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0032271d-c458-494b-8b39-448573638335 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:14.466790 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-0032271d-c458-494b-8b39-448573638335 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:14.500327 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-51efc75f-3ce0-44d9-87d5-d25e2e8b5857 req-f16ddf27-1c73-40fb-92c7-6f31bc4b8d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5650c278-eb32-4bf2-a688-4e60c50f70dc", "tag": "bda2df52-be16-4d4f-9fcf-0a7ade9c417f"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:27:14.514880 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-51efc75f-3ce0-44d9-87d5-d25e2e8b5857 req-f16ddf27-1c73-40fb-92c7-6f31bc4b8d91 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:14.515320 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-51efc75f-3ce0-44d9-87d5-d25e2e8b5857 req-f16ddf27-1c73-40fb-92c7-6f31bc4b8d91 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:14.550215 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-51efc75f-3ce0-44d9-87d5-d25e2e8b5857 req-f16ddf27-1c73-40fb-92c7-6f31bc4b8d91 service nova] Creating event network-changed:bda2df52-be16-4d4f-9fcf-0a7ade9c417f for instance 5650c278-eb32-4bf2-a688-4e60c50f70dc on hv-cinder-79760 Jul 25 12:27:14.559510 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-51efc75f-3ce0-44d9-87d5-d25e2e8b5857 req-f16ddf27-1c73-40fb-92c7-6f31bc4b8d91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062627 Jul 25 12:27:14.560639 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 491/990] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:27:14.626625 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-0032271d-c458-494b-8b39-448573638335 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:14.636898 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-0032271d-c458-494b-8b39-448573638335 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1267 microversion: 2.1 time: 0.181726 Jul 25 12:27:14.637738 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 500/991] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:14 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:15.661634 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-17575a62-5e28-4251-b8b6-7b5cd1b39168 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:15.662491 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-17575a62-5e28-4251-b8b6-7b5cd1b39168 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:15.669062 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17575a62-5e28-4251-b8b6-7b5cd1b39168 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:15.669550 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17575a62-5e28-4251-b8b6-7b5cd1b39168 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:15.670406 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17575a62-5e28-4251-b8b6-7b5cd1b39168 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:15.670893 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-17575a62-5e28-4251-b8b6-7b5cd1b39168 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:15.907763 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-17575a62-5e28-4251-b8b6-7b5cd1b39168 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:15.915083 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-17575a62-5e28-4251-b8b6-7b5cd1b39168 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1267 microversion: 2.1 time: 0.258105 Jul 25 12:27:15.915659 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 492/992] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:15 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1267 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:16.935734 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-38521a38-ea74-4c36-b57e-66ed79c160d7 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:16.936343 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-38521a38-ea74-4c36-b57e-66ed79c160d7 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:16.943010 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38521a38-ea74-4c36-b57e-66ed79c160d7 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:16.943465 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38521a38-ea74-4c36-b57e-66ed79c160d7 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:16.944290 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38521a38-ea74-4c36-b57e-66ed79c160d7 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:16.944727 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-38521a38-ea74-4c36-b57e-66ed79c160d7 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:17.070573 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-38521a38-ea74-4c36-b57e-66ed79c160d7 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:17.078621 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-38521a38-ea74-4c36-b57e-66ed79c160d7 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1267 microversion: 2.1 time: 0.146801 Jul 25 12:27:17.079192 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 501/993] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:16 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:18.099738 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-1f72826c-4f16-4987-9269-270b35101beb tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:18.100385 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-1f72826c-4f16-4987-9269-270b35101beb tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:18.107465 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f72826c-4f16-4987-9269-270b35101beb tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:18.107939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f72826c-4f16-4987-9269-270b35101beb tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:18.108693 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f72826c-4f16-4987-9269-270b35101beb tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:18.109127 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-1f72826c-4f16-4987-9269-270b35101beb tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:18.244083 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-1f72826c-4f16-4987-9269-270b35101beb tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:18.252715 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-1f72826c-4f16-4987-9269-270b35101beb tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1267 microversion: 2.1 time: 0.156613 Jul 25 12:27:18.253705 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 493/994] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:18 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:19.274033 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-c41db661-75c0-4d6b-8ad8-bcf46b12368f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:19.274703 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-c41db661-75c0-4d6b-8ad8-bcf46b12368f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:19.285198 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c41db661-75c0-4d6b-8ad8-bcf46b12368f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:19.285881 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c41db661-75c0-4d6b-8ad8-bcf46b12368f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:19.287282 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c41db661-75c0-4d6b-8ad8-bcf46b12368f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:19.287812 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-c41db661-75c0-4d6b-8ad8-bcf46b12368f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:19.419375 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-c41db661-75c0-4d6b-8ad8-bcf46b12368f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:19.426922 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-c41db661-75c0-4d6b-8ad8-bcf46b12368f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1267 microversion: 2.1 time: 0.156726 Jul 25 12:27:19.427507 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 502/995] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:19 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:20.448781 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-76f469ef-51f9-4978-9c6c-945b808dc645 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:20.449387 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-76f469ef-51f9-4978-9c6c-945b808dc645 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:20.455850 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76f469ef-51f9-4978-9c6c-945b808dc645 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:20.456302 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76f469ef-51f9-4978-9c6c-945b808dc645 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:20.457068 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76f469ef-51f9-4978-9c6c-945b808dc645 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:20.457507 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-76f469ef-51f9-4978-9c6c-945b808dc645 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:20.587235 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-76f469ef-51f9-4978-9c6c-945b808dc645 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:20.594702 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-76f469ef-51f9-4978-9c6c-945b808dc645 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1267 microversion: 2.1 time: 0.150490 Jul 25 12:27:20.595272 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 494/996] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:20 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:21.616289 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-657b5e80-b09a-455f-a98d-17ddd5c27157 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:21.616950 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-657b5e80-b09a-455f-a98d-17ddd5c27157 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:21.623375 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-657b5e80-b09a-455f-a98d-17ddd5c27157 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:21.623927 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-657b5e80-b09a-455f-a98d-17ddd5c27157 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:21.624696 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-657b5e80-b09a-455f-a98d-17ddd5c27157 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:21.625132 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-657b5e80-b09a-455f-a98d-17ddd5c27157 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:21.752155 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-657b5e80-b09a-455f-a98d-17ddd5c27157 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:21.759516 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-657b5e80-b09a-455f-a98d-17ddd5c27157 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1267 microversion: 2.1 time: 0.147218 Jul 25 12:27:21.760100 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 503/997] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:21 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:22.781408 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c937a7a5-b09d-4359-bd88-bfdfe8e7f1b0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:22.782247 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c937a7a5-b09d-4359-bd88-bfdfe8e7f1b0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:22.784790 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:27:22.785458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell0:SELECT=6 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:27:22.792877 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c937a7a5-b09d-4359-bd88-bfdfe8e7f1b0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:22.793319 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c937a7a5-b09d-4359-bd88-bfdfe8e7f1b0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:22.794081 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c937a7a5-b09d-4359-bd88-bfdfe8e7f1b0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:22.794515 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c937a7a5-b09d-4359-bd88-bfdfe8e7f1b0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:22.924714 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c937a7a5-b09d-4359-bd88-bfdfe8e7f1b0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:22.932201 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c937a7a5-b09d-4359-bd88-bfdfe8e7f1b0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1267 microversion: 2.1 time: 0.154649 Jul 25 12:27:22.932771 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 495/998] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:22 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:23.552740 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-2f8632fb-830a-4de5-b5ea-d795e52f76b0 req-010a303d-6062-46a4-8f3c-f1c9f0e93fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5650c278-eb32-4bf2-a688-4e60c50f70dc", "name": "network-vif-plugged", "status": "completed", "tag": "bda2df52-be16-4d4f-9fcf-0a7ade9c417f"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:27:23.559774 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell0:SELECT=2 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:27:23.565175 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-2f8632fb-830a-4de5-b5ea-d795e52f76b0 req-010a303d-6062-46a4-8f3c-f1c9f0e93fa1 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:23.565624 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-2f8632fb-830a-4de5-b5ea-d795e52f76b0 req-010a303d-6062-46a4-8f3c-f1c9f0e93fa1 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:23.577563 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-2f8632fb-830a-4de5-b5ea-d795e52f76b0 req-010a303d-6062-46a4-8f3c-f1c9f0e93fa1 service nova] Creating event network-vif-plugged:bda2df52-be16-4d4f-9fcf-0a7ade9c417f for instance 5650c278-eb32-4bf2-a688-4e60c50f70dc on hv-cinder-79760 Jul 25 12:27:23.582483 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-2f8632fb-830a-4de5-b5ea-d795e52f76b0 req-010a303d-6062-46a4-8f3c-f1c9f0e93fa1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033814 Jul 25 12:27:23.583064 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 504/999] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:27:23.952805 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-8a242c74-885e-46ff-84f0-379ee880da9b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:23.953352 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-8a242c74-885e-46ff-84f0-379ee880da9b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:23.959813 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a242c74-885e-46ff-84f0-379ee880da9b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:23.960261 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a242c74-885e-46ff-84f0-379ee880da9b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:23.961019 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a242c74-885e-46ff-84f0-379ee880da9b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:23.961452 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-8a242c74-885e-46ff-84f0-379ee880da9b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:24.092591 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-8a242c74-885e-46ff-84f0-379ee880da9b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:24.100179 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-8a242c74-885e-46ff-84f0-379ee880da9b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1267 microversion: 2.1 time: 0.151284 Jul 25 12:27:24.100737 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 496/1000] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:23 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:25.122949 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-500a3160-a185-4303-897c-eefd22cd8280 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:25.123678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-500a3160-a185-4303-897c-eefd22cd8280 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:25.129904 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-500a3160-a185-4303-897c-eefd22cd8280 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:25.130357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-500a3160-a185-4303-897c-eefd22cd8280 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:25.131120 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-500a3160-a185-4303-897c-eefd22cd8280 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:25.131573 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-500a3160-a185-4303-897c-eefd22cd8280 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:25.267094 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-500a3160-a185-4303-897c-eefd22cd8280 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:25.274993 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-500a3160-a185-4303-897c-eefd22cd8280 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1267 microversion: 2.1 time: 0.157440 Jul 25 12:27:25.275701 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 505/1001] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:25 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:26.295906 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-b778a1a3-c586-46a2-ab34-8f6a972190da tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:26.296516 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-b778a1a3-c586-46a2-ab34-8f6a972190da tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:26.302984 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b778a1a3-c586-46a2-ab34-8f6a972190da tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:26.303427 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b778a1a3-c586-46a2-ab34-8f6a972190da tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:26.304211 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b778a1a3-c586-46a2-ab34-8f6a972190da tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:26.304647 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-b778a1a3-c586-46a2-ab34-8f6a972190da tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:26.433876 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-b778a1a3-c586-46a2-ab34-8f6a972190da tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:26.441350 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-b778a1a3-c586-46a2-ab34-8f6a972190da tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1454 microversion: 2.1 time: 0.149318 Jul 25 12:27:26.441904 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 497/1002] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:26 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:26.461694 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-229656eb-02f1-41e0-af4b-c90377f9bd0d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:27:26.462313 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-229656eb-02f1-41e0-af4b-c90377f9bd0d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:27:26.468876 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-229656eb-02f1-41e0-af4b-c90377f9bd0d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:26.469326 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-229656eb-02f1-41e0-af4b-c90377f9bd0d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:26.470089 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-229656eb-02f1-41e0-af4b-c90377f9bd0d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:26.470524 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-229656eb-02f1-41e0-af4b-c90377f9bd0d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:26.602624 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-229656eb-02f1-41e0-af4b-c90377f9bd0d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:27:26.610776 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-229656eb-02f1-41e0-af4b-c90377f9bd0d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1454 microversion: 2.1 time: 0.153026 Jul 25 12:27:26.611336 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 506/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:27:26 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:27:28.405462 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-cf454c54-cc83-4b32-af9c-9bee16e85ce7 req-35bea2ce-334b-4224-90ea-47e9668bcf9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5650c278-eb32-4bf2-a688-4e60c50f70dc", "tag": "bda2df52-be16-4d4f-9fcf-0a7ade9c417f"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:27:28.415324 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-cf454c54-cc83-4b32-af9c-9bee16e85ce7 req-35bea2ce-334b-4224-90ea-47e9668bcf9e service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:27:28.415797 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-cf454c54-cc83-4b32-af9c-9bee16e85ce7 req-35bea2ce-334b-4224-90ea-47e9668bcf9e service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:27:28.427390 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-cf454c54-cc83-4b32-af9c-9bee16e85ce7 req-35bea2ce-334b-4224-90ea-47e9668bcf9e service nova] Creating event network-changed:bda2df52-be16-4d4f-9fcf-0a7ade9c417f for instance 5650c278-eb32-4bf2-a688-4e60c50f70dc on hv-cinder-79760 Jul 25 12:27:28.432422 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-cf454c54-cc83-4b32-af9c-9bee16e85ce7 req-35bea2ce-334b-4224-90ea-47e9668bcf9e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030619 Jul 25 12:27:28.433108 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 498/1004] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:28:05.939706 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:28:05.940253 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Mon Jul 25 12:28:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:28:16.708902 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:28:16.709502 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Mon Jul 25 12:28:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:28:16.755982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-4dbcb240-0381-43de-9ef9-d5aad35cbbf3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:28:16.756519 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-4dbcb240-0381-43de-9ef9-d5aad35cbbf3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:16.758529 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=18 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:28:16.759317 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=38 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:28:16.765379 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4dbcb240-0381-43de-9ef9-d5aad35cbbf3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:16.766350 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4dbcb240-0381-43de-9ef9-d5aad35cbbf3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:16.767137 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4dbcb240-0381-43de-9ef9-d5aad35cbbf3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:16.767598 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-4dbcb240-0381-43de-9ef9-d5aad35cbbf3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:16.791218 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.objects.instance [None req-4dbcb240-0381-43de-9ef9-d5aad35cbbf3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lazy-loading 'flavor' on Instance uuid d1a52c51-3bf0-49e4-b87f-6917ff4807df {{(pid=117777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:28:16.860177 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-4dbcb240-0381-43de-9ef9-d5aad35cbbf3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "POST /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df/action" status: 202 len: 0 microversion: 2.1 time: 0.107881 Jul 25 12:28:16.861160 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 507/1005] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:28:16 2022] POST /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:28:16.868828 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:28:16.869748 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=48 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:28:16.874139 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-d66d5ba3-a239-4fd6-bbba-bdbc6b9fae2d tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:16.874847 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-d66d5ba3-a239-4fd6-bbba-bdbc6b9fae2d tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:16.882258 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d66d5ba3-a239-4fd6-bbba-bdbc6b9fae2d tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:16.882710 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d66d5ba3-a239-4fd6-bbba-bdbc6b9fae2d tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:16.883655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d66d5ba3-a239-4fd6-bbba-bdbc6b9fae2d tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:16.884089 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-d66d5ba3-a239-4fd6-bbba-bdbc6b9fae2d tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:17.012759 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-d66d5ba3-a239-4fd6-bbba-bdbc6b9fae2d tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:17.020796 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-d66d5ba3-a239-4fd6-bbba-bdbc6b9fae2d tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1566 microversion: 2.1 time: 0.154219 Jul 25 12:28:17.021344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 499/1006] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:16 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:18.044068 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-d578e78b-263a-4d97-94c0-20d339073fc0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:18.044777 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-d578e78b-263a-4d97-94c0-20d339073fc0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:18.052259 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d578e78b-263a-4d97-94c0-20d339073fc0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:18.052870 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d578e78b-263a-4d97-94c0-20d339073fc0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:18.054097 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d578e78b-263a-4d97-94c0-20d339073fc0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:18.054792 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-d578e78b-263a-4d97-94c0-20d339073fc0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:18.184532 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-d578e78b-263a-4d97-94c0-20d339073fc0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:18.192120 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-d578e78b-263a-4d97-94c0-20d339073fc0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1566 microversion: 2.1 time: 0.153273 Jul 25 12:28:18.192687 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 508/1007] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:18 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:19.214338 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-069d9302-5f1a-43df-955c-8d8a778b6ad3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:19.214953 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-069d9302-5f1a-43df-955c-8d8a778b6ad3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:19.221586 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-069d9302-5f1a-43df-955c-8d8a778b6ad3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:19.222038 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-069d9302-5f1a-43df-955c-8d8a778b6ad3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:19.222842 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-069d9302-5f1a-43df-955c-8d8a778b6ad3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:19.223274 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-069d9302-5f1a-43df-955c-8d8a778b6ad3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:19.362681 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-069d9302-5f1a-43df-955c-8d8a778b6ad3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:19.373058 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-069d9302-5f1a-43df-955c-8d8a778b6ad3 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1566 microversion: 2.1 time: 0.162481 Jul 25 12:28:19.373835 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 500/1008] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:19 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:20.400986 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-04115cd6-da85-453d-ad4b-873c2f6d3138 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:20.401623 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-04115cd6-da85-453d-ad4b-873c2f6d3138 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:20.408136 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04115cd6-da85-453d-ad4b-873c2f6d3138 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:20.408593 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04115cd6-da85-453d-ad4b-873c2f6d3138 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:20.409357 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04115cd6-da85-453d-ad4b-873c2f6d3138 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:20.409797 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-04115cd6-da85-453d-ad4b-873c2f6d3138 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:20.542777 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-04115cd6-da85-453d-ad4b-873c2f6d3138 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:20.550701 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-04115cd6-da85-453d-ad4b-873c2f6d3138 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1566 microversion: 2.1 time: 0.154941 Jul 25 12:28:20.551256 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 509/1009] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:20 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:21.573939 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-f3db5ce8-d8ba-4322-8efa-69f9c7d67880 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:21.574556 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-f3db5ce8-d8ba-4322-8efa-69f9c7d67880 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:21.581656 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3db5ce8-d8ba-4322-8efa-69f9c7d67880 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:21.582097 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3db5ce8-d8ba-4322-8efa-69f9c7d67880 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:21.582852 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3db5ce8-d8ba-4322-8efa-69f9c7d67880 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:21.583282 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-f3db5ce8-d8ba-4322-8efa-69f9c7d67880 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:21.715855 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-f3db5ce8-d8ba-4322-8efa-69f9c7d67880 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:21.723577 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-f3db5ce8-d8ba-4322-8efa-69f9c7d67880 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1566 microversion: 2.1 time: 0.153609 Jul 25 12:28:21.724142 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 501/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:21 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:22.744796 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-01416c34-a5cc-4bf7-8ad8-bb6110f48261 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:22.745396 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-01416c34-a5cc-4bf7-8ad8-bb6110f48261 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:22.751954 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-01416c34-a5cc-4bf7-8ad8-bb6110f48261 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:22.752405 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-01416c34-a5cc-4bf7-8ad8-bb6110f48261 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:22.753164 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-01416c34-a5cc-4bf7-8ad8-bb6110f48261 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:22.753600 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-01416c34-a5cc-4bf7-8ad8-bb6110f48261 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:22.881423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-01416c34-a5cc-4bf7-8ad8-bb6110f48261 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:22.888874 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-01416c34-a5cc-4bf7-8ad8-bb6110f48261 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1566 microversion: 2.1 time: 0.147972 Jul 25 12:28:22.889430 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 510/1011] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:22 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:23.911443 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-6183c6c2-83b2-4a32-86ad-9a6a5e5b3e06 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:23.912119 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-6183c6c2-83b2-4a32-86ad-9a6a5e5b3e06 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:23.918816 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6183c6c2-83b2-4a32-86ad-9a6a5e5b3e06 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:23.919258 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6183c6c2-83b2-4a32-86ad-9a6a5e5b3e06 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:23.920037 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6183c6c2-83b2-4a32-86ad-9a6a5e5b3e06 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:23.920483 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-6183c6c2-83b2-4a32-86ad-9a6a5e5b3e06 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:24.051922 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-6183c6c2-83b2-4a32-86ad-9a6a5e5b3e06 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:24.059229 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-6183c6c2-83b2-4a32-86ad-9a6a5e5b3e06 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1566 microversion: 2.1 time: 0.152202 Jul 25 12:28:24.059845 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 502/1012] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:23 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:25.080515 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2460f219-56fa-428f-b55e-7c7ed1e925f9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:25.081133 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2460f219-56fa-428f-b55e-7c7ed1e925f9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:25.087678 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2460f219-56fa-428f-b55e-7c7ed1e925f9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:25.088131 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2460f219-56fa-428f-b55e-7c7ed1e925f9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:25.088896 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2460f219-56fa-428f-b55e-7c7ed1e925f9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:25.089360 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2460f219-56fa-428f-b55e-7c7ed1e925f9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:25.220032 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2460f219-56fa-428f-b55e-7c7ed1e925f9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:25.227830 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2460f219-56fa-428f-b55e-7c7ed1e925f9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1566 microversion: 2.1 time: 0.151166 Jul 25 12:28:25.228407 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 511/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:25 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:26.249894 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c14bf395-e409-4b58-b0a0-702c29ac7c90 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:26.250503 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c14bf395-e409-4b58-b0a0-702c29ac7c90 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:26.257449 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c14bf395-e409-4b58-b0a0-702c29ac7c90 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:26.257890 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c14bf395-e409-4b58-b0a0-702c29ac7c90 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:26.258645 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c14bf395-e409-4b58-b0a0-702c29ac7c90 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:26.259073 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c14bf395-e409-4b58-b0a0-702c29ac7c90 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:26.397712 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c14bf395-e409-4b58-b0a0-702c29ac7c90 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:26.405155 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c14bf395-e409-4b58-b0a0-702c29ac7c90 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1566 microversion: 2.1 time: 0.159160 Jul 25 12:28:26.405720 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 503/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:26 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:27.427342 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-5e47635f-78ca-4e5f-83dd-16c44fc388d9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:27.428011 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-5e47635f-78ca-4e5f-83dd-16c44fc388d9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:27.434553 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e47635f-78ca-4e5f-83dd-16c44fc388d9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:27.434997 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e47635f-78ca-4e5f-83dd-16c44fc388d9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:27.435785 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e47635f-78ca-4e5f-83dd-16c44fc388d9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:27.436219 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-5e47635f-78ca-4e5f-83dd-16c44fc388d9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:27.571019 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-5e47635f-78ca-4e5f-83dd-16c44fc388d9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:27.584138 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-5e47635f-78ca-4e5f-83dd-16c44fc388d9 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1566 microversion: 2.1 time: 0.160614 Jul 25 12:28:27.584719 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 512/1015] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:27 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:28.605750 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-bff4f479-2980-434d-93b9-5c2a3a841409 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:28.606365 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-bff4f479-2980-434d-93b9-5c2a3a841409 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:28.613656 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bff4f479-2980-434d-93b9-5c2a3a841409 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:28.614104 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bff4f479-2980-434d-93b9-5c2a3a841409 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:28.614873 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bff4f479-2980-434d-93b9-5c2a3a841409 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:28.615343 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-bff4f479-2980-434d-93b9-5c2a3a841409 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:28.745574 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-bff4f479-2980-434d-93b9-5c2a3a841409 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:28.753700 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-bff4f479-2980-434d-93b9-5c2a3a841409 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1566 microversion: 2.1 time: 0.151871 Jul 25 12:28:28.754250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 504/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:28 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:29.774821 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8f409967-8609-458b-b5ff-dab1f4bf2b78 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:29.775578 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8f409967-8609-458b-b5ff-dab1f4bf2b78 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:29.782098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f409967-8609-458b-b5ff-dab1f4bf2b78 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:29.782546 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f409967-8609-458b-b5ff-dab1f4bf2b78 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:29.783346 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f409967-8609-458b-b5ff-dab1f4bf2b78 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:29.784374 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8f409967-8609-458b-b5ff-dab1f4bf2b78 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:29.912088 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8f409967-8609-458b-b5ff-dab1f4bf2b78 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:29.919672 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8f409967-8609-458b-b5ff-dab1f4bf2b78 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1507 microversion: 2.1 time: 0.148763 Jul 25 12:28:29.920225 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 513/1017] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:29 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:29.940342 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-018c857f-ff06-4126-b452-36bd139da28b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:28:29.941018 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-018c857f-ff06-4126-b452-36bd139da28b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:29.947681 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-018c857f-ff06-4126-b452-36bd139da28b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:29.948161 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-018c857f-ff06-4126-b452-36bd139da28b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:29.948937 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-018c857f-ff06-4126-b452-36bd139da28b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:29.949366 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-018c857f-ff06-4126-b452-36bd139da28b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:30.081866 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-018c857f-ff06-4126-b452-36bd139da28b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "POST /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df/action" status: 202 len: 0 microversion: 2.1 time: 0.145803 Jul 25 12:28:30.082463 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 505/1018] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Jul 25 12:28:29 2022] POST /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:28:30.090421 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-fb4efcab-d792-4b60-86b6-8f67d78cd0ed tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:30.091034 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-fb4efcab-d792-4b60-86b6-8f67d78cd0ed tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:30.096987 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb4efcab-d792-4b60-86b6-8f67d78cd0ed tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:30.097445 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb4efcab-d792-4b60-86b6-8f67d78cd0ed tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:30.098205 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb4efcab-d792-4b60-86b6-8f67d78cd0ed tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:30.098640 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-fb4efcab-d792-4b60-86b6-8f67d78cd0ed tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:30.234984 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-fb4efcab-d792-4b60-86b6-8f67d78cd0ed tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:30.243364 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-fb4efcab-d792-4b60-86b6-8f67d78cd0ed tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1515 microversion: 2.1 time: 0.156720 Jul 25 12:28:30.243994 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 514/1019] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:30 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:31.271157 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-882607f4-e6ea-4d12-8cd7-586866ec50fd tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:31.271732 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-882607f4-e6ea-4d12-8cd7-586866ec50fd tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:31.277770 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-882607f4-e6ea-4d12-8cd7-586866ec50fd tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:31.278220 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-882607f4-e6ea-4d12-8cd7-586866ec50fd tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:31.278979 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-882607f4-e6ea-4d12-8cd7-586866ec50fd tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:31.279413 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-882607f4-e6ea-4d12-8cd7-586866ec50fd tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:31.407944 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-882607f4-e6ea-4d12-8cd7-586866ec50fd tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:31.415901 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-882607f4-e6ea-4d12-8cd7-586866ec50fd tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1573 microversion: 2.1 time: 0.149581 Jul 25 12:28:31.416467 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 506/1020] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:31 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:31.923084 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-eed23f10-5965-4be5-8f42-75075c89d795 req-04bfbab4-7b83-4a67-afa5-e3565a2cd570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a52c51-3bf0-49e4-b87f-6917ff4807df", "name": "network-vif-unplugged", "status": "completed", "tag": "ce9adc4d-f014-4c86-ab08-37edf3c4210e"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:28:31.934130 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-eed23f10-5965-4be5-8f42-75075c89d795 req-04bfbab4-7b83-4a67-afa5-e3565a2cd570 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:31.934584 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-eed23f10-5965-4be5-8f42-75075c89d795 req-04bfbab4-7b83-4a67-afa5-e3565a2cd570 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:31.946973 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-eed23f10-5965-4be5-8f42-75075c89d795 req-04bfbab4-7b83-4a67-afa5-e3565a2cd570 service nova] Creating event network-vif-unplugged:ce9adc4d-f014-4c86-ab08-37edf3c4210e for instance d1a52c51-3bf0-49e4-b87f-6917ff4807df on hv-cinder-79760 Jul 25 12:28:31.951903 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-eed23f10-5965-4be5-8f42-75075c89d795 req-04bfbab4-7b83-4a67-afa5-e3565a2cd570 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032603 Jul 25 12:28:31.952484 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 515/1021] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:28:32.437923 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3d667c04-17e0-418f-a221-4b3d8982683e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:32.438536 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3d667c04-17e0-418f-a221-4b3d8982683e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:32.445032 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d667c04-17e0-418f-a221-4b3d8982683e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:32.445480 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d667c04-17e0-418f-a221-4b3d8982683e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:32.446231 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d667c04-17e0-418f-a221-4b3d8982683e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:32.446663 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3d667c04-17e0-418f-a221-4b3d8982683e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:32.581695 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3d667c04-17e0-418f-a221-4b3d8982683e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:32.590375 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3d667c04-17e0-418f-a221-4b3d8982683e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1573 microversion: 2.1 time: 0.156333 Jul 25 12:28:32.590949 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 507/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:32 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:33.615797 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-e32f60e4-183d-4c15-9aa2-c396a16f2f55 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:33.616491 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-e32f60e4-183d-4c15-9aa2-c396a16f2f55 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:33.622626 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e32f60e4-183d-4c15-9aa2-c396a16f2f55 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:33.623111 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e32f60e4-183d-4c15-9aa2-c396a16f2f55 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:33.623961 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e32f60e4-183d-4c15-9aa2-c396a16f2f55 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:33.624395 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-e32f60e4-183d-4c15-9aa2-c396a16f2f55 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:33.753613 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-e32f60e4-183d-4c15-9aa2-c396a16f2f55 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:33.761063 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-e32f60e4-183d-4c15-9aa2-c396a16f2f55 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1573 microversion: 2.1 time: 0.150437 Jul 25 12:28:33.761650 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 516/1023] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:33 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:34.782190 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-c14a2ee0-b2b1-4798-b63d-b2f1c989173e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:34.782799 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-c14a2ee0-b2b1-4798-b63d-b2f1c989173e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:34.789627 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c14a2ee0-b2b1-4798-b63d-b2f1c989173e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:34.790067 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c14a2ee0-b2b1-4798-b63d-b2f1c989173e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:34.790818 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c14a2ee0-b2b1-4798-b63d-b2f1c989173e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:34.791245 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-c14a2ee0-b2b1-4798-b63d-b2f1c989173e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:34.918006 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-c14a2ee0-b2b1-4798-b63d-b2f1c989173e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:34.926257 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-c14a2ee0-b2b1-4798-b63d-b2f1c989173e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1573 microversion: 2.1 time: 0.147934 Jul 25 12:28:34.926823 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 508/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:34 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:35.948207 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-208a1546-650c-491a-84c6-31f6acf6a61e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:35.948818 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-208a1546-650c-491a-84c6-31f6acf6a61e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:35.955039 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-208a1546-650c-491a-84c6-31f6acf6a61e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:35.955486 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-208a1546-650c-491a-84c6-31f6acf6a61e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:35.956319 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-208a1546-650c-491a-84c6-31f6acf6a61e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:35.957450 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-208a1546-650c-491a-84c6-31f6acf6a61e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:36.088376 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-208a1546-650c-491a-84c6-31f6acf6a61e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:36.096069 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-208a1546-650c-491a-84c6-31f6acf6a61e tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1573 microversion: 2.1 time: 0.151737 Jul 25 12:28:36.096645 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 517/1025] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:35 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:37.118962 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-29c37adf-d9fa-47ae-9784-a8a04bfc93bc tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:37.119602 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-29c37adf-d9fa-47ae-9784-a8a04bfc93bc tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:37.126132 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29c37adf-d9fa-47ae-9784-a8a04bfc93bc tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:37.126581 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29c37adf-d9fa-47ae-9784-a8a04bfc93bc tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:37.127348 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29c37adf-d9fa-47ae-9784-a8a04bfc93bc tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:37.127805 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-29c37adf-d9fa-47ae-9784-a8a04bfc93bc tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:37.257229 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-29c37adf-d9fa-47ae-9784-a8a04bfc93bc tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:37.264665 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-29c37adf-d9fa-47ae-9784-a8a04bfc93bc tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1573 microversion: 2.1 time: 0.149597 Jul 25 12:28:37.265220 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 509/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:37 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:38.286675 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-8e5c11e7-f4fe-4ef1-8b44-87976d36cebf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:38.287292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-8e5c11e7-f4fe-4ef1-8b44-87976d36cebf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:38.294164 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e5c11e7-f4fe-4ef1-8b44-87976d36cebf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:38.294610 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e5c11e7-f4fe-4ef1-8b44-87976d36cebf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:38.295366 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e5c11e7-f4fe-4ef1-8b44-87976d36cebf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:38.295829 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-8e5c11e7-f4fe-4ef1-8b44-87976d36cebf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:38.422823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-8e5c11e7-f4fe-4ef1-8b44-87976d36cebf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:38.430985 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-8e5c11e7-f4fe-4ef1-8b44-87976d36cebf tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1573 microversion: 2.1 time: 0.148696 Jul 25 12:28:38.431565 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 518/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:38 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:39.452005 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5d392083-cce5-4745-8f46-5ff808ee0961 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:39.452539 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5d392083-cce5-4745-8f46-5ff808ee0961 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:39.459617 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d392083-cce5-4745-8f46-5ff808ee0961 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:39.460073 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d392083-cce5-4745-8f46-5ff808ee0961 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:39.460827 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d392083-cce5-4745-8f46-5ff808ee0961 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:39.461679 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5d392083-cce5-4745-8f46-5ff808ee0961 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:39.595884 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5d392083-cce5-4745-8f46-5ff808ee0961 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:39.604048 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5d392083-cce5-4745-8f46-5ff808ee0961 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1560 microversion: 2.1 time: 0.156082 Jul 25 12:28:39.604613 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 510/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:39 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:28:41.994577 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-9ba6bed2-be78-4ede-92e1-2a80b695d199 req-cfb3ca25-8931-41f3-994e-3839a1f6c4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a52c51-3bf0-49e4-b87f-6917ff4807df", "name": "network-vif-plugged", "status": "completed", "tag": "ce9adc4d-f014-4c86-ab08-37edf3c4210e"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:28:42.004817 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-9ba6bed2-be78-4ede-92e1-2a80b695d199 req-cfb3ca25-8931-41f3-994e-3839a1f6c4b6 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:42.005356 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-9ba6bed2-be78-4ede-92e1-2a80b695d199 req-cfb3ca25-8931-41f3-994e-3839a1f6c4b6 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:42.017663 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-9ba6bed2-be78-4ede-92e1-2a80b695d199 req-cfb3ca25-8931-41f3-994e-3839a1f6c4b6 service nova] Creating event network-vif-plugged:ce9adc4d-f014-4c86-ab08-37edf3c4210e for instance d1a52c51-3bf0-49e4-b87f-6917ff4807df on hv-cinder-79760 Jul 25 12:28:42.022721 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-9ba6bed2-be78-4ede-92e1-2a80b695d199 req-cfb3ca25-8931-41f3-994e-3839a1f6c4b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031884 Jul 25 12:28:42.023491 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 519/1029] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:28:59.125924 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-43a4f31a-279a-4649-8cbd-c0adf9384def tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:59.126453 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-43a4f31a-279a-4649-8cbd-c0adf9384def tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:59.128898 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=26 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:28:59.129554 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:28:59.137286 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=26 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:28:59.138554 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:28:59.143087 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43a4f31a-279a-4649-8cbd-c0adf9384def tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:59.143565 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43a4f31a-279a-4649-8cbd-c0adf9384def tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:59.144362 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43a4f31a-279a-4649-8cbd-c0adf9384def tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:59.144793 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-43a4f31a-279a-4649-8cbd-c0adf9384def tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:59.172186 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-43a4f31a-279a-4649-8cbd-c0adf9384def tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:28:59.201760 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-20472a09-26a5-4909-9d43-a8ae38827070 req-14e0e1cf-e140-4081-9702-6d9515e16caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5650c278-eb32-4bf2-a688-4e60c50f70dc", "tag": "bda2df52-be16-4d4f-9fcf-0a7ade9c417f"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:28:59.212101 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-20472a09-26a5-4909-9d43-a8ae38827070 req-14e0e1cf-e140-4081-9702-6d9515e16caf service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:59.212541 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-20472a09-26a5-4909-9d43-a8ae38827070 req-14e0e1cf-e140-4081-9702-6d9515e16caf service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:59.223566 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-20472a09-26a5-4909-9d43-a8ae38827070 req-14e0e1cf-e140-4081-9702-6d9515e16caf service nova] Creating event network-changed:bda2df52-be16-4d4f-9fcf-0a7ade9c417f for instance 5650c278-eb32-4bf2-a688-4e60c50f70dc on hv-cinder-79760 Jul 25 12:28:59.229604 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-20472a09-26a5-4909-9d43-a8ae38827070 req-14e0e1cf-e140-4081-9702-6d9515e16caf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097192 Jul 25 12:28:59.233579 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 520/1030] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:28:59.255327 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-43a4f31a-279a-4649-8cbd-c0adf9384def tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 204 len: 0 microversion: 2.1 time: 0.133024 Jul 25 12:28:59.256191 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 511/1031] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:28:59 2022] DELETE /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:28:59.264842 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-78da9007-9c85-4eff-8496-853cf84ee45b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:28:59.265539 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-78da9007-9c85-4eff-8496-853cf84ee45b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:28:59.274092 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78da9007-9c85-4eff-8496-853cf84ee45b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:59.274539 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78da9007-9c85-4eff-8496-853cf84ee45b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:59.275304 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78da9007-9c85-4eff-8496-853cf84ee45b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:28:59.275759 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78da9007-9c85-4eff-8496-853cf84ee45b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:28:59.412790 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-78da9007-9c85-4eff-8496-853cf84ee45b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:28:59.420587 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-78da9007-9c85-4eff-8496-853cf84ee45b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1578 microversion: 2.1 time: 0.159955 Jul 25 12:28:59.421264 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 521/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:28:59 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:00.442246 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5417548d-174a-4033-a485-bc711fe52c8b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:00.442952 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5417548d-174a-4033-a485-bc711fe52c8b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:00.450141 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5417548d-174a-4033-a485-bc711fe52c8b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:00.450585 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5417548d-174a-4033-a485-bc711fe52c8b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:00.451344 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5417548d-174a-4033-a485-bc711fe52c8b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:00.451798 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5417548d-174a-4033-a485-bc711fe52c8b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:00.603057 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-5417548d-174a-4033-a485-bc711fe52c8b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:29:00.613546 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5417548d-174a-4033-a485-bc711fe52c8b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1578 microversion: 2.1 time: 0.175539 Jul 25 12:29:00.614604 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 512/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:29:00 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:01.636241 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-2b44c741-1f31-40f8-b142-ca51d98ffd24 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:01.636833 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-2b44c741-1f31-40f8-b142-ca51d98ffd24 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:01.643254 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b44c741-1f31-40f8-b142-ca51d98ffd24 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:01.643726 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b44c741-1f31-40f8-b142-ca51d98ffd24 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:01.644527 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b44c741-1f31-40f8-b142-ca51d98ffd24 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:01.644961 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-2b44c741-1f31-40f8-b142-ca51d98ffd24 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:01.710201 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-2b44c741-1f31-40f8-b142-ca51d98ffd24 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:29:01.717847 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-2b44c741-1f31-40f8-b142-ca51d98ffd24 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 200 len: 1392 microversion: 2.1 time: 0.086022 Jul 25 12:29:01.718418 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 522/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:29:01 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 1392 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:01.744697 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-38c8767b-97d8-4e5b-aaaf-356635b2db92 req-da544075-86e9-4ad5-ad4c-43edff5f3b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5650c278-eb32-4bf2-a688-4e60c50f70dc", "name": "network-vif-deleted", "tag": "bda2df52-be16-4d4f-9fcf-0a7ade9c417f"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:01.754819 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-38c8767b-97d8-4e5b-aaaf-356635b2db92 req-da544075-86e9-4ad5-ad4c-43edff5f3b6c service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:01.755261 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-38c8767b-97d8-4e5b-aaaf-356635b2db92 req-da544075-86e9-4ad5-ad4c-43edff5f3b6c service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:01.767248 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-38c8767b-97d8-4e5b-aaaf-356635b2db92 req-da544075-86e9-4ad5-ad4c-43edff5f3b6c service nova] Creating event network-vif-deleted:bda2df52-be16-4d4f-9fcf-0a7ade9c417f for instance 5650c278-eb32-4bf2-a688-4e60c50f70dc on hv-cinder-79760 Jul 25 12:29:01.774954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-38c8767b-97d8-4e5b-aaaf-356635b2db92 req-da544075-86e9-4ad5-ad4c-43edff5f3b6c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034338 Jul 25 12:29:01.776050 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 513/1035] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:02.738515 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-14d521be-eb19-47ce-8a3b-5001aa6f018a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:02.739061 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-14d521be-eb19-47ce-8a3b-5001aa6f018a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 5650c278-eb32-4bf2-a688-4e60c50f70dc] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:02.746157 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14d521be-eb19-47ce-8a3b-5001aa6f018a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:02.746624 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14d521be-eb19-47ce-8a3b-5001aa6f018a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:02.747371 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14d521be-eb19-47ce-8a3b-5001aa6f018a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:02.747831 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-14d521be-eb19-47ce-8a3b-5001aa6f018a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:02.761572 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-14d521be-eb19-47ce-8a3b-5001aa6f018a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] HTTP exception thrown: Instance 5650c278-eb32-4bf2-a688-4e60c50f70dc could not be found. Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-14d521be-eb19-47ce-8a3b-5001aa6f018a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Request method failure captured: Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc HTTP/1.1 Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3orbQVzhDsWVUKbWg3qiCpVhDwiGmxa5cV1nRTNN_-QLHjSv_Xcj_SvuujIapOhKCXSh5t1GBsK3oRW5WN-jVGpVKqd9bLuf3FU0lK0-gPVow9xZ4iR9H-d55wNqE3hZKsnxHV52Vp5u2eMpv7Qk9IJr8khZ2-5OK-zGihaNisr3KJ0 Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 141003bbc94b41569683aef4c15b46f1 Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:29:02.763265 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:29:02.764990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_141003bbc94b41569683aef4c15b46f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:29:02.764990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:29:02.764990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 141003bbc94b41569683aef4c15b46f1 Jul 25 12:29:02.764990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:29:02.764990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-TestVolumeBootPattern-1028467132-project Jul 25 12:29:02.764990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:29:02.764990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:29:02.764990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 3494ce75df62497bb737254fd1665a3b Jul 25 12:29:02.764990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-TestVolumeBootPattern-1028467132-project Jul 25 12:29:02.764990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:29:02.764990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 5650c278-eb32-4bf2-a688-4e60c50f70dc could not be found. Jul 25 12:29:02.764990 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '5650c278-eb32-4bf2-a688-4e60c50f70dc'} Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5650c278-eb32-4bf2-a688-4e60c50f70dc could not be found. Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:29:02.765982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5650c278-eb32-4bf2-a688-4e60c50f70dc could not be found. Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5650c278-eb32-4bf2-a688-4e60c50f70dc could not be found. Jul 25 12:29:02.767603 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:02.769029 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-14d521be-eb19-47ce-8a3b-5001aa6f018a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Returning 404 to user: Instance 5650c278-eb32-4bf2-a688-4e60c50f70dc could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:29:02.769029 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-14d521be-eb19-47ce-8a3b-5001aa6f018a tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc" status: 404 len: 111 microversion: 2.1 time: 0.030136 Jul 25 12:29:02.769029 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 523/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:29:02 2022] GET /compute/v2.1/servers/5650c278-eb32-4bf2-a688-4e60c50f70dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:29:06.050691 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-ea8052e1-d78e-495c-9efc-5ab8b782a7e4 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:06.051277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ea8052e1-d78e-495c-9efc-5ab8b782a7e4 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:06.052638 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-5dd59d4d-6f36-4805-a2a1-e78233b8d88a req-036806bc-df37-43ae-a005-d9bbc64e6bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680a227e-0e1f-4221-ad9e-30b6eec96cb9", "tag": "ab330dd9-8cf2-465a-938e-753b7c9e645a"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:06.058279 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ea8052e1-d78e-495c-9efc-5ab8b782a7e4 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:06.058732 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ea8052e1-d78e-495c-9efc-5ab8b782a7e4 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:06.059663 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ea8052e1-d78e-495c-9efc-5ab8b782a7e4 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:06.060278 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-ea8052e1-d78e-495c-9efc-5ab8b782a7e4 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:06.063170 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-5dd59d4d-6f36-4805-a2a1-e78233b8d88a req-036806bc-df37-43ae-a005-d9bbc64e6bbc service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:06.063998 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-5dd59d4d-6f36-4805-a2a1-e78233b8d88a req-036806bc-df37-43ae-a005-d9bbc64e6bbc service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:06.075464 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-5dd59d4d-6f36-4805-a2a1-e78233b8d88a req-036806bc-df37-43ae-a005-d9bbc64e6bbc service nova] Creating event network-changed:ab330dd9-8cf2-465a-938e-753b7c9e645a for instance 680a227e-0e1f-4221-ad9e-30b6eec96cb9 on hv-cinder-79760 Jul 25 12:29:06.080517 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-5dd59d4d-6f36-4805-a2a1-e78233b8d88a req-036806bc-df37-43ae-a005-d9bbc64e6bbc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032303 Jul 25 12:29:06.081105 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 524/1037] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:06.090528 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-ea8052e1-d78e-495c-9efc-5ab8b782a7e4 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Going to try to terminate instance {{(pid=117776) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:29:06.179399 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-ea8052e1-d78e-495c-9efc-5ab8b782a7e4 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "DELETE /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 204 len: 0 microversion: 2.1 time: 0.133029 Jul 25 12:29:06.180914 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 514/1038] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:29:06 2022] DELETE /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:29:06.191823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-00a5d191-f94e-4f0d-94e1-db927f51ae60 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:06.192616 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-00a5d191-f94e-4f0d-94e1-db927f51ae60 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:06.199429 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00a5d191-f94e-4f0d-94e1-db927f51ae60 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:06.199904 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00a5d191-f94e-4f0d-94e1-db927f51ae60 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:06.200710 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00a5d191-f94e-4f0d-94e1-db927f51ae60 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:06.201143 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-00a5d191-f94e-4f0d-94e1-db927f51ae60 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:06.342269 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-00a5d191-f94e-4f0d-94e1-db927f51ae60 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:29:06.349851 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-00a5d191-f94e-4f0d-94e1-db927f51ae60 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1578 microversion: 2.1 time: 0.162944 Jul 25 12:29:06.350413 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 525/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:29:06 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:29:07.373216 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-0c0adb99-8267-463b-85ff-5c160fc5785f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:07.373915 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-0c0adb99-8267-463b-85ff-5c160fc5785f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:07.379962 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c0adb99-8267-463b-85ff-5c160fc5785f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:07.380397 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c0adb99-8267-463b-85ff-5c160fc5785f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:07.381154 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c0adb99-8267-463b-85ff-5c160fc5785f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:07.381588 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-0c0adb99-8267-463b-85ff-5c160fc5785f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:07.594304 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-0c0adb99-8267-463b-85ff-5c160fc5785f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:29:07.602337 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-0c0adb99-8267-463b-85ff-5c160fc5785f tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1578 microversion: 2.1 time: 0.233127 Jul 25 12:29:07.602895 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 515/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:29:07 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:08.214848 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [req-aec34d4a-f7eb-434e-b6db-548b4d61c613 req-753b161f-ded7-4d0d-828e-f5389f578789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680a227e-0e1f-4221-ad9e-30b6eec96cb9", "name": "network-vif-deleted", "tag": "ab330dd9-8cf2-465a-938e-753b7c9e645a"}]} {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:08.227857 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-aec34d4a-f7eb-434e-b6db-548b4d61c613 req-753b161f-ded7-4d0d-828e-f5389f578789 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:08.228389 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [req-aec34d4a-f7eb-434e-b6db-548b4d61c613 req-753b161f-ded7-4d0d-828e-f5389f578789 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:08.240428 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.compute.server_external_events [req-aec34d4a-f7eb-434e-b6db-548b4d61c613 req-753b161f-ded7-4d0d-828e-f5389f578789 service nova] Creating event network-vif-deleted:ab330dd9-8cf2-465a-938e-753b7c9e645a for instance 680a227e-0e1f-4221-ad9e-30b6eec96cb9 on hv-cinder-79760 Jul 25 12:29:08.246114 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [req-aec34d4a-f7eb-434e-b6db-548b4d61c613 req-753b161f-ded7-4d0d-828e-f5389f578789 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035645 Jul 25 12:29:08.246700 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 526/1041] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:08.623331 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-be21da73-40cc-4d24-9b3f-989a0bf8341d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:08.623978 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-be21da73-40cc-4d24-9b3f-989a0bf8341d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:08.630621 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be21da73-40cc-4d24-9b3f-989a0bf8341d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:08.631067 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be21da73-40cc-4d24-9b3f-989a0bf8341d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:08.631861 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be21da73-40cc-4d24-9b3f-989a0bf8341d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:08.632292 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be21da73-40cc-4d24-9b3f-989a0bf8341d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:08.662930 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be21da73-40cc-4d24-9b3f-989a0bf8341d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:08.663374 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-be21da73-40cc-4d24-9b3f-989a0bf8341d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:08.663849 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.objects.instance [None req-be21da73-40cc-4d24-9b3f-989a0bf8341d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lazy-loading 'fault' on Instance uuid 680a227e-0e1f-4221-ad9e-30b6eec96cb9 {{(pid=117776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:29:08.705171 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-be21da73-40cc-4d24-9b3f-989a0bf8341d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3494ce75df62497bb737254fd1665a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141003bbc94b41569683aef4c15b46f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:29:08.712636 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-be21da73-40cc-4d24-9b3f-989a0bf8341d tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 200 len: 1230 microversion: 2.1 time: 0.093244 Jul 25 12:29:08.713233 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 516/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:29:08 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:09.734315 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a65b4831-efab-4551-aabb-2161c8575f4b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:09.734980 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-a65b4831-efab-4551-aabb-2161c8575f4b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: 680a227e-0e1f-4221-ad9e-30b6eec96cb9] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:09.741855 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a65b4831-efab-4551-aabb-2161c8575f4b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:09.742348 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a65b4831-efab-4551-aabb-2161c8575f4b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:09.743183 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a65b4831-efab-4551-aabb-2161c8575f4b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:09.743676 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-a65b4831-efab-4551-aabb-2161c8575f4b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:09.756822 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-a65b4831-efab-4551-aabb-2161c8575f4b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] HTTP exception thrown: Instance 680a227e-0e1f-4221-ad9e-30b6eec96cb9 could not be found. Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a65b4831-efab-4551-aabb-2161c8575f4b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Request method failure captured: Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 HTTP/1.1 Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3orbQVzhDsWVUKbWg3qiCpVhDwiGmxa5cV1nRTNN_-QLHjSv_Xcj_SvuujIapOhKCXSh5t1GBsK3oRW5WN-jVGpVKqd9bLuf3FU0lK0-gPVow9xZ4iR9H-d55wNqE3hZKsnxHV52Vp5u2eMpv7Qk9IJr8khZ2-5OK-zGihaNisr3KJ0 Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 141003bbc94b41569683aef4c15b46f1 Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:29:09.759046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:29:09.760690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_141003bbc94b41569683aef4c15b46f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:29:09.760690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:29:09.760690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 141003bbc94b41569683aef4c15b46f1 Jul 25 12:29:09.760690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:29:09.760690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-TestVolumeBootPattern-1028467132-project Jul 25 12:29:09.760690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:29:09.760690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:29:09.760690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 3494ce75df62497bb737254fd1665a3b Jul 25 12:29:09.760690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-TestVolumeBootPattern-1028467132-project Jul 25 12:29:09.760690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:29:09.760690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance 680a227e-0e1f-4221-ad9e-30b6eec96cb9 could not be found. Jul 25 12:29:09.760690 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': '680a227e-0e1f-4221-ad9e-30b6eec96cb9'} Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 680a227e-0e1f-4221-ad9e-30b6eec96cb9 could not be found. Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:29:09.761697 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 680a227e-0e1f-4221-ad9e-30b6eec96cb9 could not be found. Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 680a227e-0e1f-4221-ad9e-30b6eec96cb9 could not be found. Jul 25 12:29:09.763007 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:09.764268 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-a65b4831-efab-4551-aabb-2161c8575f4b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Returning 404 to user: Instance 680a227e-0e1f-4221-ad9e-30b6eec96cb9 could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:29:09.764268 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-a65b4831-efab-4551-aabb-2161c8575f4b tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9" status: 404 len: 111 microversion: 2.1 time: 0.030436 Jul 25 12:29:09.764268 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 527/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:29:09 2022] GET /compute/v2.1/servers/680a227e-0e1f-4221-ad9e-30b6eec96cb9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:29:10.196773 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-34b409f3-0b8b-4853-9f49-5a4c0c3d39a0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:10.197277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-34b409f3-0b8b-4853-9f49-5a4c0c3d39a0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:10.203802 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-34b409f3-0b8b-4853-9f49-5a4c0c3d39a0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:10.204250 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-34b409f3-0b8b-4853-9f49-5a4c0c3d39a0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:10.205006 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-34b409f3-0b8b-4853-9f49-5a4c0c3d39a0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:10.205437 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-34b409f3-0b8b-4853-9f49-5a4c0c3d39a0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:10.218523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-34b409f3-0b8b-4853-9f49-5a4c0c3d39a0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] HTTP exception thrown: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-34b409f3-0b8b-4853-9f49-5a4c0c3d39a0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Request method failure captured: Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: DELETE /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a HTTP/1.1 Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3orbQVzhDsWVUKbWg3qiCpVhDwiGmxa5cV1nRTNN_-QLHjSv_Xcj_SvuujIapOhKCXSh5t1GBsK3oRW5WN-jVGpVKqd9bLuf3FU0lK0-gPVow9xZ4iR9H-d55wNqE3hZKsnxHV52Vp5u2eMpv7Qk9IJr8khZ2-5OK-zGihaNisr3KJ0 Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 141003bbc94b41569683aef4c15b46f1 Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:29:10.220188 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:29:10.221801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_141003bbc94b41569683aef4c15b46f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:29:10.221801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:29:10.221801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 141003bbc94b41569683aef4c15b46f1 Jul 25 12:29:10.221801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:29:10.221801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-TestVolumeBootPattern-1028467132-project Jul 25 12:29:10.221801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:29:10.221801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:29:10.221801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: 3494ce75df62497bb737254fd1665a3b Jul 25 12:29:10.221801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-TestVolumeBootPattern-1028467132-project Jul 25 12:29:10.221801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:29:10.221801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:29:10.221801 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': 'f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a'} Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:29:10.222810 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:29:10.224623 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:29:10.226148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-34b409f3-0b8b-4853-9f49-5a4c0c3d39a0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Returning 404 to user: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:29:10.226148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-34b409f3-0b8b-4853-9f49-5a4c0c3d39a0 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 404 len: 111 microversion: 2.1 time: 0.029309 Jul 25 12:29:10.226148 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 517/1044] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:29:10 2022] DELETE /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:29:10.230023 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9033e406-0b27-41ad-97e4-71bd7b8780e3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:10.230662 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-9033e406-0b27-41ad-97e4-71bd7b8780e3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] [instance: f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:10.236582 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9033e406-0b27-41ad-97e4-71bd7b8780e3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:10.237024 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9033e406-0b27-41ad-97e4-71bd7b8780e3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:10.237773 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9033e406-0b27-41ad-97e4-71bd7b8780e3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:10.238197 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-9033e406-0b27-41ad-97e4-71bd7b8780e3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:10.251774 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.wsgi [None req-9033e406-0b27-41ad-97e4-71bd7b8780e3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] HTTP exception thrown: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9033e406-0b27-41ad-97e4-71bd7b8780e3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Request method failure captured: Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: request: GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a HTTP/1.1 Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept: application/json Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Accept-Encoding: identity Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Connection: close Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Length: 0 Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Content-Type: application/json Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Host: 10.222.0.42 Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Openstack-System-Scope: None Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: User-Agent: python-urllib3/1.26.10 Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Auth-Token: gAAAAABi3orbQVzhDsWVUKbWg3qiCpVhDwiGmxa5cV1nRTNN_-QLHjSv_Xcj_SvuujIapOhKCXSh5t1GBsK3oRW5WN-jVGpVKqd9bLuf3FU0lK0-gPVow9xZ4iR9H-d55wNqE3hZKsnxHV52Vp5u2eMpv7Qk9IJr8khZ2-5OK-zGihaNisr3KJ0 Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Id: None Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Domain-Name: None Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Identity-Status: Confirmed Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Is-Admin-Project: True Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Id: default Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Domain-Name: Default Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Id: 141003bbc94b41569683aef4c15b46f1 Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Project-Name: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Role: reader,member Jul 25 12:29:10.253292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Roles: reader,member Jul 25 12:29:10.254871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_141003bbc94b41569683aef4c15b46f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/141003bbc94b41569683aef4c15b46f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:29:10.254871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:29:10.254871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Id: 141003bbc94b41569683aef4c15b46f1 Jul 25 12:29:10.254871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1028467132 Jul 25 12:29:10.254871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User: tempest-TestVolumeBootPattern-1028467132-project Jul 25 12:29:10.254871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Id: default Jul 25 12:29:10.254871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Domain-Name: Default Jul 25 12:29:10.254871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Id: 3494ce75df62497bb737254fd1665a3b Jul 25 12:29:10.254871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: X-User-Name: tempest-TestVolumeBootPattern-1028467132-project Jul 25 12:29:10.254871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: method: > Jul 25 12:29:10.254871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: exception: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:29:10.254871 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: action_args: {'id': 'f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a'} Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:29:10.255823 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. Jul 25 12:29:10.257436 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: ERROR nova.api.openstack.wsgi Jul 25 12:29:10.259705 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-9033e406-0b27-41ad-97e4-71bd7b8780e3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Returning 404 to user: Instance f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a could not be found. {{(pid=117777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:29:10.259705 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-9033e406-0b27-41ad-97e4-71bd7b8780e3 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a" status: 404 len: 111 microversion: 2.1 time: 0.028403 Jul 25 12:29:10.259705 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 528/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:29:10 2022] GET /compute/v2.1/servers/f076d2c5-3cc0-44bc-b018-0a0ec6bcef1a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:29:11.546919 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-63582670-8076-493c-b189-3a2c25470993 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] Calling method '.version_select at 0x7f942c337b80>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:11.573616 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-63582670-8076-493c-b189-3a2c25470993 tempest-TestVolumeBootPattern-1028467132 tempest-TestVolumeBootPattern-1028467132-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1809500551" status: 202 len: 0 microversion: 2.1 time: 0.030426 Jul 25 12:29:11.574445 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 518/1046] 10.222.0.42 () {58 vars in 1263 bytes} [Mon Jul 25 12:29:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1809500551 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:29:55.413383 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:55.414024 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-78a764d1-ef98-4b97-a8a0-535bb848541c tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:55.414393 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-78a764d1-ef98-4b97-a8a0-535bb848541c tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:55.414487 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG dbcounter [-] [117776] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:55.419531 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-edd26322-1f67-49e0-bdd4-10d6bb2c248c req-42255729-4295-4415-aa6e-ee25699a6a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1a52c51-3bf0-49e4-b87f-6917ff4807df", "tag": "ce9adc4d-f014-4c86-ab08-37edf3c4210e"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:55.419719 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_api:SELECT=18 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:55.420473 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG dbcounter [-] [117777] Writing DB stats nova_cell1:SELECT=30 {{(pid=117777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:29:55.431702 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78a764d1-ef98-4b97-a8a0-535bb848541c tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:55.432884 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78a764d1-ef98-4b97-a8a0-535bb848541c tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:55.433097 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-edd26322-1f67-49e0-bdd4-10d6bb2c248c req-42255729-4295-4415-aa6e-ee25699a6a44 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:55.433515 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-edd26322-1f67-49e0-bdd4-10d6bb2c248c req-42255729-4295-4415-aa6e-ee25699a6a44 service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:55.433658 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78a764d1-ef98-4b97-a8a0-535bb848541c tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:55.433982 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-78a764d1-ef98-4b97-a8a0-535bb848541c tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:55.446655 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-edd26322-1f67-49e0-bdd4-10d6bb2c248c req-42255729-4295-4415-aa6e-ee25699a6a44 service nova] Creating event network-changed:ce9adc4d-f014-4c86-ab08-37edf3c4210e for instance d1a52c51-3bf0-49e4-b87f-6917ff4807df on hv-cinder-79760 Jul 25 12:29:55.452457 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-edd26322-1f67-49e0-bdd4-10d6bb2c248c req-42255729-4295-4415-aa6e-ee25699a6a44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040555 Jul 25 12:29:55.453249 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 519/1047] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:55.462389 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-78a764d1-ef98-4b97-a8a0-535bb848541c tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Going to try to terminate instance {{(pid=117777) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:29:55.539882 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-78a764d1-ef98-4b97-a8a0-535bb848541c tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 204 len: 0 microversion: 2.1 time: 0.129936 Jul 25 12:29:55.540467 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 529/1048] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Jul 25 12:29:55 2022] DELETE /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:29:55.549768 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-3502c679-ce96-4d5e-8ec8-33ab97d06d3b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:55.550458 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-3502c679-ce96-4d5e-8ec8-33ab97d06d3b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:55.557263 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3502c679-ce96-4d5e-8ec8-33ab97d06d3b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:55.557718 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3502c679-ce96-4d5e-8ec8-33ab97d06d3b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:55.558478 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3502c679-ce96-4d5e-8ec8-33ab97d06d3b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:55.558914 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-3502c679-ce96-4d5e-8ec8-33ab97d06d3b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:55.914196 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.policy [None req-3502c679-ce96-4d5e-8ec8-33ab97d06d3b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117776) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:29:55.923160 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-3502c679-ce96-4d5e-8ec8-33ab97d06d3b tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1448 microversion: 2.1 time: 0.377473 Jul 25 12:29:55.924007 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 520/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:29:55 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1448 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:56.945709 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-050ecfd0-5ed2-46bd-b31e-27035cb9c2f0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:56.946411 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-050ecfd0-5ed2-46bd-b31e-27035cb9c2f0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:56.952978 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-050ecfd0-5ed2-46bd-b31e-27035cb9c2f0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:56.953423 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-050ecfd0-5ed2-46bd-b31e-27035cb9c2f0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:56.954210 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-050ecfd0-5ed2-46bd-b31e-27035cb9c2f0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:56.954638 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-050ecfd0-5ed2-46bd-b31e-27035cb9c2f0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:57.138589 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-050ecfd0-5ed2-46bd-b31e-27035cb9c2f0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:29:57.146046 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-050ecfd0-5ed2-46bd-b31e-27035cb9c2f0 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1448 microversion: 2.1 time: 0.204632 Jul 25 12:29:57.146600 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 530/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:29:56 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1448 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:57.919379 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [req-0bf792f7-db87-4810-b09f-9b8fe8f62b37 req-e407c5fc-7e8e-4849-8feb-23f36541955a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a52c51-3bf0-49e4-b87f-6917ff4807df", "name": "network-vif-deleted", "tag": "ce9adc4d-f014-4c86-ab08-37edf3c4210e"}]} {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:29:57.929574 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-0bf792f7-db87-4810-b09f-9b8fe8f62b37 req-e407c5fc-7e8e-4849-8feb-23f36541955a service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:57.929955 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [req-0bf792f7-db87-4810-b09f-9b8fe8f62b37 req-e407c5fc-7e8e-4849-8feb-23f36541955a service nova] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:57.942197 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.compute.server_external_events [req-0bf792f7-db87-4810-b09f-9b8fe8f62b37 req-e407c5fc-7e8e-4849-8feb-23f36541955a service nova] Creating event network-vif-deleted:ce9adc4d-f014-4c86-ab08-37edf3c4210e for instance d1a52c51-3bf0-49e4-b87f-6917ff4807df on hv-cinder-79760 Jul 25 12:29:57.947896 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [req-0bf792f7-db87-4810-b09f-9b8fe8f62b37 req-e407c5fc-7e8e-4849-8feb-23f36541955a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031946 Jul 25 12:29:57.948478 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 521/1051] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Jul 25 12:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:29:58.167795 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-50d1b4e7-17bb-4205-a0a3-827d61e3324f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:58.168579 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.compute.api [None req-50d1b4e7-17bb-4205-a0a3-827d61e3324f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117777) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:58.175647 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50d1b4e7-17bb-4205-a0a3-827d61e3324f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:58.176098 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50d1b4e7-17bb-4205-a0a3-827d61e3324f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:58.176861 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50d1b4e7-17bb-4205-a0a3-827d61e3324f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:58.177292 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG oslo_concurrency.lockutils [None req-50d1b4e7-17bb-4205-a0a3-827d61e3324f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:58.250477 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.policy [None req-50d1b4e7-17bb-4205-a0a3-827d61e3324f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb6dd7dc1af4bc79386df797dab6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376f79202b2d46b4bff1b67d8b10add6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117777) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:29:58.259023 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-50d1b4e7-17bb-4205-a0a3-827d61e3324f tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 200 len: 1219 microversion: 2.1 time: 0.095140 Jul 25 12:29:58.259926 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 531/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:29:58 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:29:59.281942 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5f1e8020-5ae3-49a2-bcdf-8bd20199ce62 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '>' {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:59.282629 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.compute.api [None req-5f1e8020-5ae3-49a2-bcdf-8bd20199ce62 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] [instance: d1a52c51-3bf0-49e4-b87f-6917ff4807df] Fetching instance by UUID {{(pid=117776) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:29:59.288782 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f1e8020-5ae3-49a2-bcdf-8bd20199ce62 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:59.289218 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f1e8020-5ae3-49a2-bcdf-8bd20199ce62 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:59.289966 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f1e8020-5ae3-49a2-bcdf-8bd20199ce62 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:29:59.290391 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG oslo_concurrency.lockutils [None req-5f1e8020-5ae3-49a2-bcdf-8bd20199ce62 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Lock "bd86971f-66ee-4017-8a4d-2ac53750a8a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:29:59.303784 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.wsgi [None req-5f1e8020-5ae3-49a2-bcdf-8bd20199ce62 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] HTTP exception thrown: Instance d1a52c51-3bf0-49e4-b87f-6917ff4807df could not be found. Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5f1e8020-5ae3-49a2-bcdf-8bd20199ce62 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Request method failure captured: Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: request: GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df HTTP/1.1 Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept: application/json Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Accept-Encoding: identity Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Connection: close Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Length: 0 Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Content-Type: application/json Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Host: 10.222.0.42 Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Openstack-System-Scope: None Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: User-Agent: python-urllib3/1.26.10 Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Auth-Token: gAAAAABi3ovGz2rzfKY1mEVGU5VQaW-J4GOpcM0AWiaEvQuq5iLresJPmcWeL17QmtzaSmA8vZRieRUfhr0KS00abvnA6iOKc8UsRNPfPAsvZIZ80zGlkOO0qlTw53ICx9Ewden3Sfdydt97sDMtPhTgYFUqg14L7uN-lQgMyNYjs27eFBseSec Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Id: None Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Domain-Name: None Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Identity-Status: Confirmed Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Is-Admin-Project: True Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Id: default Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Domain-Name: Default Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Id: 376f79202b2d46b4bff1b67d8b10add6 Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Project-Name: tempest-TestShelveInstance-1547470338 Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Role: reader,member Jul 25 12:29:59.305364 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Roles: reader,member Jul 25 12:29:59.307076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/376f79202b2d46b4bff1b67d8b10add6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/376f79202b2d46b4bff1b67d8b10add6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_376f79202b2d46b4bff1b67d8b10add6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/376f79202b2d46b4bff1b67d8b10add6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}] Jul 25 12:29:59.307076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant: tempest-TestShelveInstance-1547470338 Jul 25 12:29:59.307076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Id: 376f79202b2d46b4bff1b67d8b10add6 Jul 25 12:29:59.307076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-Tenant-Name: tempest-TestShelveInstance-1547470338 Jul 25 12:29:59.307076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User: tempest-TestShelveInstance-1547470338-project Jul 25 12:29:59.307076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Id: default Jul 25 12:29:59.307076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Domain-Name: Default Jul 25 12:29:59.307076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Id: edb6dd7dc1af4bc79386df797dab6e1e Jul 25 12:29:59.307076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: X-User-Name: tempest-TestShelveInstance-1547470338-project Jul 25 12:29:59.307076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: method: > Jul 25 12:29:59.307076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: exception: Instance d1a52c51-3bf0-49e4-b87f-6917ff4807df could not be found. Jul 25 12:29:59.307076 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: action_args: {'id': 'd1a52c51-3bf0-49e4-b87f-6917ff4807df'} Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: {{(pid=117776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a52c51-3bf0-49e4-b87f-6917ff4807df could not be found. Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:29:59.308277 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a52c51-3bf0-49e4-b87f-6917ff4807df could not be found. Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a52c51-3bf0-49e4-b87f-6917ff4807df could not be found. Jul 25 12:29:59.309954 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: ERROR nova.api.openstack.wsgi Jul 25 12:29:59.311497 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: DEBUG nova.api.openstack.wsgi [None req-5f1e8020-5ae3-49a2-bcdf-8bd20199ce62 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Returning 404 to user: Instance d1a52c51-3bf0-49e4-b87f-6917ff4807df could not be found. {{(pid=117776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:29:59.311497 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO nova.api.openstack.requestlog [None req-5f1e8020-5ae3-49a2-bcdf-8bd20199ce62 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df" status: 404 len: 111 microversion: 2.1 time: 0.029437 Jul 25 12:29:59.311497 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: [pid: 117776|app: 0|req: 522/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Jul 25 12:29:59 2022] GET /compute/v2.1/servers/d1a52c51-3bf0-49e4-b87f-6917ff4807df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:29:59.472075 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: DEBUG nova.api.openstack.wsgi [None req-364b8478-6471-4e4f-b163-f2d89aa25499 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] Calling method '.version_select at 0x7f942c395d30>' {{(pid=117777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:29:59.496210 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO nova.api.openstack.requestlog [None req-364b8478-6471-4e4f-b163-f2d89aa25499 tempest-TestShelveInstance-1547470338 tempest-TestShelveInstance-1547470338-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-785289464" status: 202 len: 0 microversion: 2.1 time: 0.027925 Jul 25 12:29:59.496798 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: [pid: 117777|app: 0|req: 532/1054] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Jul 25 12:29:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-785289464 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:31:35.924283 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:31:35.924765 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Mon Jul 25 12:31:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:31:36.717193 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:31:36.717404 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Mon Jul 25 12:31:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:31:37.327802 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:31:37.328389 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Mon Jul 25 12:31:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:33:05.950830 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:33:05.951456 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Mon Jul 25 12:33:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:34:55.932870 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:34:55.933393 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Mon Jul 25 12:34:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:34:56.725315 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:34:56.725523 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Mon Jul 25 12:34:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:34:57.335778 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:34:57.336352 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Mon Jul 25 12:34:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:35:16.960466 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:35:16.961081 dv-cinder-797608-61-iscsi devstack@n-api.service[117776]: Mon Jul 25 12:35:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:35:19.989235 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:35:19.989818 dv-cinder-797608-61-iscsi devstack@n-api.service[117777]: Mon Jul 25 12:35:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!